-- Logs begin at Tue 2022-07-05 19:55:56 UTC, end at Tue 2022-07-05 21:15:53 UTC. -- Jul 05 20:45:55.083888 dv-cinder-797608-49-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jul 05 20:45:55.093302 dv-cinder-797608-49-iscsi devstack@n-api.service[103146]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 05 20:45:55.095278 dv-cinder-797608-49-iscsi devstack@n-api.service[103146]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Jul 5 20:45:55 2022] *** Jul 05 20:45:55.095278 dv-cinder-797608-49-iscsi devstack@n-api.service[103146]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 05 20:45:55.095278 dv-cinder-797608-49-iscsi devstack@n-api.service[103146]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 05 20:45:55.095278 dv-cinder-797608-49-iscsi devstack@n-api.service[103146]: nodename: dv-cinder-797608-49-iscsi Jul 05 20:45:55.095278 dv-cinder-797608-49-iscsi devstack@n-api.service[103146]: machine: x86_64 Jul 05 20:45:55.095278 dv-cinder-797608-49-iscsi devstack@n-api.service[103146]: clock source: unix Jul 05 20:45:55.095278 dv-cinder-797608-49-iscsi devstack@n-api.service[103146]: pcre jit disabled Jul 05 20:45:55.095278 dv-cinder-797608-49-iscsi devstack@n-api.service[103146]: detected number of CPU cores: 4 Jul 05 20:45:55.095278 dv-cinder-797608-49-iscsi devstack@n-api.service[103146]: current working directory: / Jul 05 20:45:55.095278 dv-cinder-797608-49-iscsi devstack@n-api.service[103146]: detected binary path: /usr/bin/uwsgi-core Jul 05 20:45:55.095278 dv-cinder-797608-49-iscsi devstack@n-api.service[103146]: your processes number limit is 47680 Jul 05 20:45:55.095278 dv-cinder-797608-49-iscsi devstack@n-api.service[103146]: your memory page size is 4096 bytes Jul 05 20:45:55.095278 dv-cinder-797608-49-iscsi devstack@n-api.service[103146]: detected max file descriptor number: 2048 Jul 05 20:45:55.095278 dv-cinder-797608-49-iscsi devstack@n-api.service[103146]: lock engine: pthread robust mutexes Jul 05 20:45:55.096225 dv-cinder-797608-49-iscsi devstack@n-api.service[103146]: thunder lock: enabled Jul 05 20:45:55.096225 dv-cinder-797608-49-iscsi devstack@n-api.service[103146]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 05 20:45:55.096225 dv-cinder-797608-49-iscsi devstack@n-api.service[103146]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jul 05 20:45:55.139400 dv-cinder-797608-49-iscsi devstack@n-api.service[103146]: Python main interpreter initialized at 0x55c8879699c0 Jul 05 20:45:55.139400 dv-cinder-797608-49-iscsi devstack@n-api.service[103146]: python threads support enabled Jul 05 20:45:55.139400 dv-cinder-797608-49-iscsi devstack@n-api.service[103146]: your server socket listen backlog is limited to 100 connections Jul 05 20:45:55.139400 dv-cinder-797608-49-iscsi devstack@n-api.service[103146]: your mercy for graceful operations on workers is 90 seconds Jul 05 20:45:55.139767 dv-cinder-797608-49-iscsi devstack@n-api.service[103146]: mapped 403077 bytes (393 KB) for 2 cores Jul 05 20:45:55.139845 dv-cinder-797608-49-iscsi devstack@n-api.service[103146]: *** Operational MODE: preforking *** Jul 05 20:45:55.140051 dv-cinder-797608-49-iscsi devstack@n-api.service[103146]: *** uWSGI is running in multiple interpreter mode *** Jul 05 20:45:55.140051 dv-cinder-797608-49-iscsi devstack@n-api.service[103146]: spawned uWSGI master process (pid: 103146) Jul 05 20:45:55.140237 dv-cinder-797608-49-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jul 05 20:45:55.141298 dv-cinder-797608-49-iscsi devstack@n-api.service[103146]: spawned uWSGI worker 1 (pid: 103147, cores: 1) Jul 05 20:45:55.141298 dv-cinder-797608-49-iscsi devstack@n-api.service[103146]: spawned uWSGI worker 2 (pid: 103148, cores: 1) Jul 05 20:45:55.141298 dv-cinder-797608-49-iscsi devstack@n-api.service[103146]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 05 20:45:55.807954 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 05 20:45:55.812026 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 05 20:45:56.937366 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 05 20:45:56.937366 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: from cryptography.utils import int_from_bytes Jul 05 20:45:56.938053 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 05 20:45:56.938053 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: from cryptography.utils import int_from_bytes Jul 05 20:45:56.939137 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 05 20:45:56.939137 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: from cryptography.utils import int_from_bytes Jul 05 20:45:56.939565 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 05 20:45:56.939565 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: from cryptography.utils import int_from_bytes Jul 05 20:45:59.394425 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 05 20:45:59.395008 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 05 20:45:59.395175 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 05 20:45:59.395533 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 05 20:45:59.395784 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 05 20:45:59.396164 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:45:59.396484 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:45:59.396800 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:45:59.397146 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:45:59.398860 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:45:59.398860 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:45:59.398860 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:45:59.398860 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:45:59.398860 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:45:59.399238 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:45:59.399325 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:45:59.399603 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-797608-49-iscsi {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:45:59.399881 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 05 20:45:59.400286 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:45:59.400370 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 05 20:45:59.400448 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:45:59.400525 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:45:59.400664 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 05 20:45:59.400807 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:45:59.401046 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 05 20:45:59.401164 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:45:59.401303 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 05 20:45:59.401437 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:45:59.401691 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:45:59.401795 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:45:59.402013 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:45:59.402220 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:45:59.402333 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:45:59.402638 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:45:59.402737 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:45:59.402951 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:45:59.403038 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:45:59.403257 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:45:59.403356 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:45:59.403571 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:45:59.403659 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:45:59.403886 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:45:59.403982 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:45:59.404189 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:45:59.404286 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:45:59.404457 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:45:59.404555 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:45:59.404769 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:45:59.404867 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:45:59.405120 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-797608-49-iscsi {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:45:59.405212 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:45:59.405423 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:45:59.405519 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:45:59.405734 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:45:59.405822 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-797608-49-iscsi {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:45:59.406044 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:45:59.406132 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:45:59.406360 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:45:59.406462 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:45:59.406679 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:45:59.406821 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:45:59.406973 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:45:59.407129 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:45:59.407272 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:45:59.407424 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:45:59.407676 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:45:59.407834 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:45:59.408011 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:45:59.408388 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:45:59.408574 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:45:59.408675 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:45:59.408879 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:45:59.408984 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:45:59.409226 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:45:59.409316 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:45:59.409539 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:45:59.409712 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:45:59.409830 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:45:59.409916 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:45:59.410149 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:45:59.410245 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:45:59.410442 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:45:59.410525 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:45:59.410743 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:45:59.410835 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:45:59.411047 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:45:59.411175 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:45:59.411355 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:45:59.411441 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-797608-49-iscsi {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:45:59.411655 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:45:59.411742 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:45:59.411954 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:45:59.412047 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:45:59.412199 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:45:59.412320 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:45:59.412499 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:45:59.412731 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:45:59.412825 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:45:59.413629 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:45:59.413829 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:45:59.413945 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:45:59.414041 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:45:59.414193 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:45:59.414289 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:45:59.414437 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:45:59.414524 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:45:59.414752 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:45:59.414841 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:45:59.415066 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:45:59.415164 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:45:59.415367 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:45:59.415459 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:45:59.415666 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:45:59.415753 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:45:59.415964 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:45:59.416050 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:45:59.416262 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:45:59.416358 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:45:59.416561 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:45:59.416645 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:45:59.416858 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:45:59.416961 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:45:59.417184 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:45:59.417321 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:45:59.417526 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:45:59.417641 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:45:59.417824 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:45:59.417922 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:45:59.418072 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:45:59.418176 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:45:59.418377 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:45:59.418464 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:45:59.418698 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:45:59.418791 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:45:59.419016 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:45:59.419115 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:45:59.419338 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:45:59.419425 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.20 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:45:59.419589 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:45:59.419675 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.20 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:45:59.419838 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:45:59.419989 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:45:59.420158 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:45:59.420245 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:45:59.420476 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:45:59.420569 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:45:59.420781 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:45:59.420868 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:45:59.421119 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:45:59.421229 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:45:59.421408 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:45:59.421504 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:45:59.421713 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:45:59.421798 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:45:59.422017 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:45:59.422112 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:45:59.422320 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:45:59.422416 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:45:59.422623 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:45:59.422716 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:45:59.422926 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:45:59.423018 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:45:59.423231 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:45:59.423325 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:45:59.423476 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:45:59.423562 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:45:59.423770 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:45:59.423854 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:45:59.424067 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:45:59.424162 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:45:59.424378 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:45:59.424464 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:45:59.424675 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:45:59.424821 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.20 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:45:59.424993 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:45:59.425094 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.20 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:45:59.425294 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:45:59.425379 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:45:59.425587 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:45:59.425707 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:45:59.425885 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:45:59.426025 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:45:59.426183 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:45:59.426336 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:45:59.426481 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:45:59.426652 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:45:59.426778 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:45:59.426971 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:45:59.427076 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:45:59.427275 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:45:59.427372 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:45:59.427577 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:45:59.427677 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:45:59.427879 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:45:59.427964 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:45:59.428196 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:45:59.428282 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:45:59.429170 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:45:59.429286 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:45:59.429493 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:45:59.429586 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:45:59.429749 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:45:59.429839 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:45:59.430049 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:45:59.430136 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:45:59.430351 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:45:59.430445 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:45:59.430657 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:45:59.430794 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:45:59.430961 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:45:59.431088 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:45:59.431295 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:45:59.431421 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:45:59.431543 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:45:59.431666 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:45:59.431840 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:45:59.431966 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:45:59.432171 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:45:59.432300 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:45:59.432433 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:45:59.432562 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:45:59.432721 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:45:59.432849 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:45:59.433047 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:45:59.433189 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:45:59.433350 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:45:59.433477 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:45:59.433652 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:45:59.433780 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:45:59.433954 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:45:59.434080 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:45:59.434255 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:45:59.434381 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:45:59.434555 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:45:59.434693 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:45:59.434850 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:45:59.434976 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:45:59.435149 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:45:59.435288 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:45:59.435444 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:45:59.435564 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:45:59.435739 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:45:59.435865 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:45:59.436036 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:45:59.436171 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:45:59.436333 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:45:59.436473 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:45:59.436640 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:45:59.436796 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:45:59.436990 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:45:59.437135 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:45:59.437262 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:45:59.437392 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:45:59.437516 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:45:59.437639 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:45:59.437822 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:45:59.437959 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:45:59.438124 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:45:59.438251 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:45:59.438422 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:45:59.438548 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:45:59.438721 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:45:59.438856 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:45:59.439020 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:45:59.439146 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:45:59.439337 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:45:59.439464 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.439635 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:45:59.439772 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.439938 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:45:59.440066 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.440252 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:45:59.440385 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.440555 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:45:59.440682 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.440854 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:45:59.440999 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.441176 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:45:59.441316 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.441585 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:45:59.441715 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.441838 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:45:59.441961 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.442083 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:45:59.442213 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.442347 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:45:59.442472 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.442620 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:45:59.442747 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.442916 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:45:59.443060 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.443230 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:45:59.443361 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.443546 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:45:59.443673 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.443852 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:45:59.443992 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.444711 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:45:59.444843 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.445046 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.445173 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:45:59.445361 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.445499 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:45:59.445666 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.445792 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.445977 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.446104 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.446300 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.446439 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.446613 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.446740 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.446920 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.447098 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.447249 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.447387 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.447575 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.447717 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.447880 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.448010 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.448200 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.448335 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.448514 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.448642 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.448818 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.448965 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.449148 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.449278 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.449452 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.449578 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.449767 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.449893 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.450083 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.450218 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.450388 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.450514 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.450700 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.450842 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.451004 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.451132 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.451309 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.451444 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.451646 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.451774 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.451912 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.452037 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.452189 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.452325 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.452517 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.452654 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.452825 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.452992 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.453156 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.453283 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.453459 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.453595 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.453769 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.453897 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.454074 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.454208 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.454377 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.454513 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.454681 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.454807 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.454981 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.455108 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.455267 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.455400 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.455566 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.455701 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.455869 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.455997 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.456167 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.456302 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.456480 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.456608 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.456803 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.456953 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.457132 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.457254 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.457436 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.457562 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.457744 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.457878 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.458046 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.458180 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.458349 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.458477 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.458650 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.458784 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.458949 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.459079 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.459253 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.459380 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.459566 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.459697 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.460478 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.460610 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.460893 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.461078 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.461213 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.461355 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.461522 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.461665 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.461867 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.462005 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.462130 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.462264 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.462413 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.462540 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.462718 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.462846 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.463035 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.463173 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.463343 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.463470 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.463651 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.463786 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.463956 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.464094 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.464272 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.464398 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.464576 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.464712 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.464914 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.465067 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.465204 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.465364 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.465488 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.465611 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.465787 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.465918 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.466095 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.466222 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.466401 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.466573 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.466709 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.466834 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.467013 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.467148 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.467312 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.467438 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.467606 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.467738 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.467904 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.468037 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.468201 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.468342 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.468502 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.468629 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.468798 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.468985 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.469126 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.469294 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.469435 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.469606 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.469740 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.469909 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.470044 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.470177 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.470311 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.470436 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.470608 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.470738 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.470920 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.471056 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.471218 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.471345 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.471514 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.471651 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.471905 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.472041 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.472162 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.472273 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.472463 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.472629 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.472766 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.472892 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.473081 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.473208 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.473383 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.473510 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.473685 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.473815 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.473986 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.474122 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.474291 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.474427 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.474591 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.474720 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.474890 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.475018 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.475190 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.475346 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.475555 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.475859 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.476079 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.476286 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.476475 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.476617 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.476749 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.476874 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.477057 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.477183 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.477307 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.477449 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.477575 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.477700 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.477831 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.477980 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.478107 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.478316 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.478459 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.478650 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.478777 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.478965 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.479101 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.479278 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.479403 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.479586 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.479712 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.479888 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.480024 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.480194 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.480322 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.480494 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.480621 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.480801 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.480961 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.481128 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.481256 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.481433 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.481561 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.481739 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.481878 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.482089 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.482215 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.482347 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.482471 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.482624 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.482766 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.482940 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.483076 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.483243 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.483370 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.483546 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.483673 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.483842 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.483980 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.484147 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.484277 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.484466 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.484594 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.484790 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.484918 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.485120 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.485261 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.485426 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.485553 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.485738 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.485865 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.486039 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.486164 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.486342 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.486472 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.486644 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.486771 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.486941 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.487081 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.487240 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.487369 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.487543 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.487670 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.487852 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.487987 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.488153 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.488287 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.488454 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.488580 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.488753 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.488889 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.489085 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.489213 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.489387 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.489516 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.489686 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.489822 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.489986 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.490114 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.490291 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.490418 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.490608 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.490743 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.490911 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.491117 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.491313 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.491491 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.491632 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.491765 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.491890 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.492013 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.492216 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.492350 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.492485 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.492613 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.492737 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.492917 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.493085 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.493239 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.493450 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.493578 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.493710 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.493836 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.493959 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.494152 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.494289 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.494458 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.494597 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.494757 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.494883 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.495068 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.495196 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.495381 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.495508 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.495684 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.495812 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.495991 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.496119 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.496294 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.496431 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.496596 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.496723 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.496911 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.497063 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.497240 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.497359 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.497543 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.497663 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.497845 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.497976 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.498148 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.498282 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.498447 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.498586 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.498747 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.498873 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.499045 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.499178 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.499354 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.499493 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.499656 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.499783 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.499960 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.500088 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.500259 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.500400 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.500563 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.500689 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.500866 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.501047 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.501202 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.501451 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.501580 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.501775 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.501913 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.502084 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.502234 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.502433 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.502580 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.502705 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.502827 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.502984 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.503122 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.503290 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.503426 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.503596 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.503731 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.503901 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.504037 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.504222 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.504359 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.504525 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.504652 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.504826 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.504976 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.505154 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.505284 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.505456 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.505594 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.505751 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.505877 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.506050 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.506179 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.506348 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.507178 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.507337 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.507511 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.507640 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.507828 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.507955 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.508145 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.508273 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.508461 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.508599 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.508778 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.508906 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.509133 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.509279 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.509452 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.509581 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.509753 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.509887 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.510064 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.510204 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.510367 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.510502 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.510666 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.510800 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.510968 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.511103 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.511264 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.511403 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.511566 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.511692 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.511870 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.512005 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.512172 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.512316 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.512526 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.512674 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.512812 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.512957 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.513102 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.513230 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.513362 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.513494 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.513665 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.513800 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.513976 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.514111 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.514279 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.514414 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.514586 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.514714 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.514886 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.515020 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.515188 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.515323 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.515486 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.515612 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.515783 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.515911 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.516083 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.516208 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.516380 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.516519 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.516681 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.516808 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.516997 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.517127 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.517301 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.517511 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.517640 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.517765 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.517878 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.517999 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.518180 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.518318 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.518478 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.518605 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.518775 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.518905 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.519079 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.519215 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.519378 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.519504 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.519674 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.519813 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.519977 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.520106 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.520272 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.520400 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.520581 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.520712 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.520881 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.521054 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.521227 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.521367 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.521544 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.521679 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.521835 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.521963 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.522087 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.522245 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.522545 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.522756 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.522894 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.523021 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.523159 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.523286 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.523468 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.523608 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.523771 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.523898 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.524075 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.524204 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.524383 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.524519 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.524679 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.524807 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.525000 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.525130 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.525310 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.525452 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.525609 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.525738 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.525906 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.526065 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.526199 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.526351 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.526513 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.526649 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.526775 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.526899 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.527081 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.527211 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.527391 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.527535 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.527690 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.527853 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.527992 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.528155 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.528301 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.528460 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.528605 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.528774 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.528915 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.529074 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.529198 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.529367 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.529495 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.529672 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.529814 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.529972 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.530100 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.530272 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.530401 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.530569 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.530705 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.530912 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.531040 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.531211 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.531343 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.531526 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.531660 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.531827 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.531955 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.532129 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.532257 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.532436 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.532565 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.532809 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.533005 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.533376 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.533500 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.533641 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.533767 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.533890 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.534014 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.534171 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.534309 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.534483 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.534612 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.534785 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.534911 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.535082 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.535217 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.535378 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.535512 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.535679 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.535807 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.535981 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.536116 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.536284 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.536404 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.536599 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.536726 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.536915 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.537084 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.537246 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.537380 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.537544 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.537669 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.537880 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.538018 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.538187 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.538313 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.538500 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.538636 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.538770 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.538903 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.539069 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.539196 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.539373 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.539500 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.539680 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.539809 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.539982 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.540108 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.540285 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.540412 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.540589 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.540725 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.540891 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.541076 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.541214 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.541354 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.541489 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.541613 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.541793 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.541921 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.542111 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.542251 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.542414 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.542543 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.542712 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.542861 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.543054 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.543190 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.543315 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.543438 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.543583 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.543710 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.543880 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.544019 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.544189 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.544315 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.544499 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.544626 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.544805 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.544955 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.545136 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.545262 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.545443 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.545573 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.545769 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.545896 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.546044 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.546172 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.546349 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.546476 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.546646 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.546772 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.546964 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.547090 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.547270 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.547397 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.547573 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.547701 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.547876 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.548003 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.548175 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.548310 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.548477 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.548614 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.548778 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.548903 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.549122 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.549266 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.549420 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.549547 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.549717 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.549844 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.550014 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.550148 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.550329 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.550463 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.550626 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.550760 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.550945 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.551085 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.551262 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.551389 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.551564 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.551689 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.551924 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.552057 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.552277 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.552405 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.552587 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.552721 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.552897 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.553074 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.553273 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.553404 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.554070 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.554208 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.554395 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.554524 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.554769 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.554895 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.555075 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.555202 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.555363 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.555488 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.555670 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.555796 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.555989 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.556114 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.556290 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.556416 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.556596 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.556734 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.556899 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.557090 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.557243 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.557396 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.557607 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.557743 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.557876 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.558001 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.558161 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.558297 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.558569 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.558715 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.558888 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.559018 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.559195 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.559337 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.559511 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.559639 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.559812 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.559945 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.560122 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.560258 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.560420 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.560547 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.560731 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.560865 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.561055 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.561197 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.561357 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.561485 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.561665 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.561791 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.561964 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.562090 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.562270 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.562404 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.562574 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.562708 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.562877 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.563006 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.563178 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.563390 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.563516 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.563646 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.563786 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.563911 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.564067 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.564181 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.564384 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.564529 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.564691 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.564818 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.565029 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.565160 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.565346 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.565496 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.565647 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.565782 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.565965 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.566093 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.566266 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.566403 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.566563 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.566692 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.566861 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.566988 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.567156 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.567293 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.567460 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.567586 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.567767 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.567935 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.568075 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.568234 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.568380 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.568545 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.568685 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.568811 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.568972 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.569217 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.569382 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.569650 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.569786 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.569974 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.570138 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.570337 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.570497 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.570656 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.570827 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.570979 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.571152 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.571285 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.571411 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.571574 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.571702 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.571877 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.572007 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.572178 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.572308 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.572474 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.572600 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.572773 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.572901 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.573099 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.573211 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.573404 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.573531 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.573702 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.573799 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.573998 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.574098 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.574319 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.574423 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.574616 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.574709 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.574932 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.575032 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.575235 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.575340 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.575532 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.575624 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.575831 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.575921 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.576127 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.576227 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.576463 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.576561 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.576759 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.576879 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.577082 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.577196 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.577382 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.577475 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.577685 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.577776 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.577984 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.578084 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.578282 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.578375 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.578587 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.578697 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.578903 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.578997 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.579205 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.579304 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.579510 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.579599 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.579810 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.579901 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.580110 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.580207 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.580411 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.580502 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.580710 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.580811 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.581032 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.581140 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.581342 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.581441 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.581649 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.581742 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.581959 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.582058 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.582277 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.582469 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.582599 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.582794 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.582896 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.583103 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.583195 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.583410 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.583502 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.583716 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.583823 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.584023 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.584113 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.584333 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.584481 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.584638 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.585318 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.585580 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.585711 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.585967 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.586097 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.586276 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.586405 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.586594 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.586733 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.586974 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.587112 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.587236 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.587362 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.587548 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.587725 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.587855 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.588054 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.588190 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.588366 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.588502 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.588676 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.588804 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.589006 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.589138 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.589319 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.589461 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.589629 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.589757 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.589938 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.590075 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.590239 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.590398 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.590554 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.590687 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.590813 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.590937 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.591139 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.591281 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.591459 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.591602 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.591783 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.591911 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.592113 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.592244 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.592416 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.592544 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.592725 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.592852 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.593039 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.593167 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.593364 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.593499 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.593697 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.593816 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.594015 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.594126 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.594324 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.594444 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.594632 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.594742 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.594941 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.595041 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.595248 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.595450 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.595544 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.595757 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.595858 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.596082 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.596181 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.596400 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.596502 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.596718 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.596809 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.597049 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.597156 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.597369 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.597480 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.597666 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.597764 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.597961 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.598053 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.598261 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.598361 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.598563 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.598655 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.598866 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.598967 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.599161 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.599262 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.599475 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.599567 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.599777 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.599995 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.600100 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.600315 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.601004 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.601240 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.601332 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.601573 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.601778 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.601896 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.602117 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.602209 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.602427 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.602518 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.602751 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.602845 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.603072 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.603163 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.603385 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.603485 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.603688 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.603780 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.603992 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.604084 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.604294 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.604398 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.604595 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.604693 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.604903 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.605014 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.605229 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.605338 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.605527 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.605625 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.605825 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.605917 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.606130 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.606356 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.606449 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.606704 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.606794 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.607006 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.607106 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.607305 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.607399 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.607625 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.607723 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.607926 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.608032 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.608225 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.608316 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.608521 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.608619 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.608824 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.608966 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.609149 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.609251 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.609448 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.609551 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.609746 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.609848 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.610045 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.610136 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.610345 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.610434 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.610642 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.610739 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.610945 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.611036 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.611240 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.611329 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.611543 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.611642 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.611839 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.611937 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.612140 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.612240 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.612446 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.612545 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.612748 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.612848 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.613071 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.613165 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.613377 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.613469 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.613677 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.613766 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.613977 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.614080 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.614279 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.614377 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.614581 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.614673 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.614883 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.615058 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.615183 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.615273 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.615489 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.615580 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.615791 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.616086 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.616228 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.616421 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.616633 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.616797 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.616968 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.617156 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.617328 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.617484 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.617651 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.617792 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.617956 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.618096 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.618259 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.618400 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.618570 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.618720 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.618878 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.619027 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.619190 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.619378 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.619494 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.619627 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.619787 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.619932 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.620131 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.620223 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.620444 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.620535 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.620822 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.620997 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.621155 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.621331 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.621462 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.621647 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.621766 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.621979 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.622078 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.622307 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.622398 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.622613 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.622707 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.622918 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.623009 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.623223 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.623325 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.623543 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.623636 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.623851 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.623942 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.624159 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.624264 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.624464 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.624563 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.624771 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.624862 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.625103 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.625209 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.625411 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.625502 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.625714 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.625804 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.626018 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.626118 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.626325 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.626424 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.626636 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.626727 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.626937 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.627029 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.627240 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.627350 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.627546 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.627648 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.627856 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.627963 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.628193 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.628292 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.628509 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.628607 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.628824 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.628917 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.629162 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.629256 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.629471 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.629585 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.629775 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.629873 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.630078 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.630168 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.630381 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.630479 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.630689 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.630780 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.631003 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.631095 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.631328 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.631430 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.631685 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.631777 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.632043 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.632164 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.632346 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.632583 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.632676 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.632892 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.633006 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.633232 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.633338 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.633550 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.633642 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.633851 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.633940 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.634157 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.634257 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.634457 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.634548 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.634758 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.634848 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.635060 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.635160 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.635361 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.635459 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.635664 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.635768 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.635962 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.636059 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.636263 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.636354 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.636563 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.636653 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.636858 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.637026 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.637182 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.637275 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.637484 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.637575 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.637787 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.637879 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.638085 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.638176 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.638386 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.638477 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.638682 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.638782 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.638979 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.639070 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.639277 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.639380 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.639580 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.639681 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.639881 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.639972 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.640184 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.640285 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.640486 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.640587 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.640791 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.640881 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.641115 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.641225 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.641416 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.641508 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.641719 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.641811 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.642022 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.642122 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.642324 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.642415 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.642625 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.642715 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.642932 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.643025 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.643231 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.643322 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.643531 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.643622 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.643832 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.643926 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.644133 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.644223 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.644478 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.644575 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.644734 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.644826 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.645080 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.645174 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.645400 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.645504 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.645701 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.645801 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.646013 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.646103 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.646320 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.646419 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.646628 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.646718 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.646936 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.647025 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.647764 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.647929 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.648087 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.648180 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.648393 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.648492 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.648696 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.648799 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.649027 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.649122 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.649334 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.649425 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.649643 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.649756 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.649950 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.650055 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.650258 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.650359 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.650563 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.650661 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.650889 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.650988 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.651188 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.651277 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.651503 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.651593 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.651819 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.651908 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.652128 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.652227 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.652445 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.652537 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.652758 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.652848 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.653089 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.653197 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.653413 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.653504 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.653717 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.653806 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.654014 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.654114 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.654254 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 05 20:45:59.654345 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.654615 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.654963 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.655282 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.655596 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.655921 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.656248 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.656556 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.656884 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.657234 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.657578 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.657889 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.658486 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.658811 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.659121 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.659429 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.659731 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:45:59.659971 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 05 20:45:59.715972 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: INFO dbcounter [None req-3b20e94e-67fd-4612-9bd0-80d08588a42b None None] Registered counter for database nova_api Jul 05 20:45:59.721057 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: INFO dbcounter [None req-9fb722a7-8f06-4afa-a0d3-869885d1a1f4 None None] Registered counter for database nova_api Jul 05 20:45:59.829932 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG oslo_db.sqlalchemy.engines [None req-3b20e94e-67fd-4612-9bd0-80d08588a42b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103148) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 05 20:45:59.834018 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG oslo_db.sqlalchemy.engines [None req-9fb722a7-8f06-4afa-a0d3-869885d1a1f4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103147) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 05 20:45:59.836899 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG dbcounter [-] [103148] Writer thread running {{(pid=103148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 05 20:45:59.845874 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG dbcounter [-] [103147] Writer thread running {{(pid=103147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 05 20:45:59.892309 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.context [None req-3b20e94e-67fd-4612-9bd0-80d08588a42b None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),78cfd685-d36c-4d6a-bc57-de3ea03c21ea(cell1) {{(pid=103148) load_cells /opt/stack/nova/nova/context.py:464}} Jul 05 20:45:59.896294 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG oslo_concurrency.lockutils [None req-3b20e94e-67fd-4612-9bd0-80d08588a42b None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:45:59.898545 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG oslo_concurrency.lockutils [None req-3b20e94e-67fd-4612-9bd0-80d08588a42b None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:45:59.899333 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG oslo_concurrency.lockutils [None req-3b20e94e-67fd-4612-9bd0-80d08588a42b None None] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:45:59.901407 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG oslo_concurrency.lockutils [None req-3b20e94e-67fd-4612-9bd0-80d08588a42b None None] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:45:59.903361 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: INFO dbcounter [None req-3b20e94e-67fd-4612-9bd0-80d08588a42b None None] Registered counter for database nova_cell0 Jul 05 20:45:59.904267 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.context [None req-9fb722a7-8f06-4afa-a0d3-869885d1a1f4 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),78cfd685-d36c-4d6a-bc57-de3ea03c21ea(cell1) {{(pid=103147) load_cells /opt/stack/nova/nova/context.py:464}} Jul 05 20:45:59.907324 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: INFO dbcounter [None req-3b20e94e-67fd-4612-9bd0-80d08588a42b None None] Registered counter for database nova_cell1 Jul 05 20:45:59.908431 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG oslo_concurrency.lockutils [None req-9fb722a7-8f06-4afa-a0d3-869885d1a1f4 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103147) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:45:59.910040 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG oslo_concurrency.lockutils [None req-9fb722a7-8f06-4afa-a0d3-869885d1a1f4 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103147) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:45:59.910839 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG oslo_concurrency.lockutils [None req-9fb722a7-8f06-4afa-a0d3-869885d1a1f4 None None] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103147) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:45:59.913558 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG oslo_concurrency.lockutils [None req-9fb722a7-8f06-4afa-a0d3-869885d1a1f4 None None] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103147) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:45:59.915586 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG oslo_db.sqlalchemy.engines [None req-3b20e94e-67fd-4612-9bd0-80d08588a42b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103148) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 05 20:45:59.915733 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: INFO dbcounter [None req-9fb722a7-8f06-4afa-a0d3-869885d1a1f4 None None] Registered counter for database nova_cell0 Jul 05 20:45:59.917479 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG oslo_db.sqlalchemy.engines [None req-3b20e94e-67fd-4612-9bd0-80d08588a42b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103148) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 05 20:45:59.919635 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: INFO dbcounter [None req-9fb722a7-8f06-4afa-a0d3-869885d1a1f4 None None] Registered counter for database nova_cell1 Jul 05 20:45:59.923274 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG dbcounter [-] [103148] Writer thread running {{(pid=103148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 05 20:45:59.925859 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG dbcounter [-] [103148] Writer thread running {{(pid=103148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 05 20:45:59.927003 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG oslo_db.sqlalchemy.engines [None req-9fb722a7-8f06-4afa-a0d3-869885d1a1f4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103147) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 05 20:45:59.930626 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG oslo_db.sqlalchemy.engines [None req-9fb722a7-8f06-4afa-a0d3-869885d1a1f4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103147) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 05 20:45:59.934181 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG dbcounter [-] [103147] Writer thread running {{(pid=103147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 05 20:46:00.068962 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: INFO dbcounter [None req-3b20e94e-67fd-4612-9bd0-80d08588a42b None None] Registered counter for database nova_cell0 Jul 05 20:46:00.072835 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG dbcounter [-] [103147] Writer thread running {{(pid=103147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 05 20:46:00.078433 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG oslo_db.sqlalchemy.engines [None req-3b20e94e-67fd-4612-9bd0-80d08588a42b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103148) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 05 20:46:00.082675 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG dbcounter [-] [103148] Writer thread running {{(pid=103148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 05 20:46:00.083151 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: INFO dbcounter [None req-9fb722a7-8f06-4afa-a0d3-869885d1a1f4 None None] Registered counter for database nova_cell0 Jul 05 20:46:00.092473 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG oslo_db.sqlalchemy.engines [None req-9fb722a7-8f06-4afa-a0d3-869885d1a1f4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103147) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 05 20:46:00.096716 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG dbcounter [-] [103147] Writer thread running {{(pid=103147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 05 20:46:00.422384 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: WARNING keystonemiddleware.auth_token [None req-9fb722a7-8f06-4afa-a0d3-869885d1a1f4 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 05 20:46:00.427153 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: WARNING keystonemiddleware.auth_token [None req-3b20e94e-67fd-4612-9bd0-80d08588a42b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 05 20:46:00.430458 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: WARNING keystonemiddleware.auth_token [None req-9fb722a7-8f06-4afa-a0d3-869885d1a1f4 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 05 20:46:00.435224 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: WARNING keystonemiddleware.auth_token [None req-3b20e94e-67fd-4612-9bd0-80d08588a42b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 05 20:46:00.769060 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: WARNING keystonemiddleware.auth_token [None req-9fb722a7-8f06-4afa-a0d3-869885d1a1f4 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 05 20:46:00.775749 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: WARNING keystonemiddleware.auth_token [None req-9fb722a7-8f06-4afa-a0d3-869885d1a1f4 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 05 20:46:00.780756 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55c8879699c0 pid: 103147 (default app) Jul 05 20:46:00.781345 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: WARNING keystonemiddleware.auth_token [None req-3b20e94e-67fd-4612-9bd0-80d08588a42b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 05 20:46:00.782835 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi [None req-9fb722a7-8f06-4afa-a0d3-869885d1a1f4 None None] Calling method '>' {{(pid=103147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:46:00.784268 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: INFO nova.api.openstack.requestlog [None req-9fb722a7-8f06-4afa-a0d3-869885d1a1f4 None None] 10.222.0.20 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001991 Jul 05 20:46:00.784671 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: [pid: 103147|app: 0|req: 1/1] 10.222.0.20 () {50 vars in 788 bytes} [Tue Jul 5 20:46:00 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 20:46:00.787565 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: WARNING keystonemiddleware.auth_token [None req-3b20e94e-67fd-4612-9bd0-80d08588a42b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 05 20:46:00.793402 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55c8879699c0 pid: 103148 (default app) Jul 05 20:47:16.895338 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi [None req-9fb722a7-8f06-4afa-a0d3-869885d1a1f4 None None] Calling method '>' {{(pid=103147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:47:16.896330 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: INFO nova.api.openstack.requestlog [None req-9fb722a7-8f06-4afa-a0d3-869885d1a1f4 None None] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001412 Jul 05 20:47:16.896719 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: [pid: 103147|app: 0|req: 2/2] 10.222.0.20 () {54 vars in 930 bytes} [Tue Jul 5 20:47:16 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 20:47:16.909145 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG dbcounter [-] [103148] Writing DB stats nova_api:SELECT=3 {{(pid=103148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:47:16.911279 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG dbcounter [-] [103148] Writing DB stats nova_cell1:SELECT=3 {{(pid=103148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:47:16.911990 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG dbcounter [-] [103148] Writing DB stats nova_cell0:SELECT=3 {{(pid=103148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:47:16.913188 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG dbcounter [-] [103148] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:47:17.355332 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi [None req-eb6444a5-154d-43c9-be9f-2dc14eec68e6 admin admin] Calling method '>' {{(pid=103148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:47:17.387538 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: INFO nova.api.openstack.requestlog [None req-eb6444a5-154d-43c9-be9f-2dc14eec68e6 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.483719 Jul 05 20:47:17.388449 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: [pid: 103148|app: 0|req: 1/3] 10.222.0.20 () {60 vars in 1291 bytes} [Tue Jul 5 20:47:16 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 20:47:19.493055 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi [None req-9fb722a7-8f06-4afa-a0d3-869885d1a1f4 None None] Calling method '>' {{(pid=103147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:47:19.494083 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: INFO nova.api.openstack.requestlog [None req-9fb722a7-8f06-4afa-a0d3-869885d1a1f4 None None] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001471 Jul 05 20:47:19.494688 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: [pid: 103147|app: 0|req: 3/4] 10.222.0.20 () {54 vars in 930 bytes} [Tue Jul 5 20:47:19 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 20:47:19.558603 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi [None req-e36819e9-4144-4e17-8f3c-61fe06b39998 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 256, "swap": 0, "name": "cirros256", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 1, "id": "c1", "vcpus": 1, "os-flavor-access:is_public": true, "rxtx_factor": 1.0}} {{(pid=103148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 20:47:19.577738 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 05 20:47:19.577738 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: warnings.warn(msg) Jul 05 20:47:19.608840 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: INFO nova.api.openstack.requestlog [None req-e36819e9-4144-4e17-8f3c-61fe06b39998 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.108039 Jul 05 20:47:19.609522 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: [pid: 103148|app: 0|req: 2/5] 10.222.0.20 () {64 vars in 1282 bytes} [Tue Jul 5 20:47:19 2022] POST /compute/v2.1/flavors => generated 407 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 05 20:47:19.623790 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG dbcounter [-] [103147] Writing DB stats nova_api:SELECT=3 {{(pid=103147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:47:19.625128 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG dbcounter [-] [103147] Writing DB stats nova_cell0:SELECT=3 {{(pid=103147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:47:19.625905 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG dbcounter [-] [103147] Writing DB stats nova_cell1:SELECT=3 {{(pid=103147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:47:19.626671 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG dbcounter [-] [103147] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:47:19.840126 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi [None req-1d5ef463-8690-4ce5-aef1-3f81c53fd385 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 20:47:19.842535 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 05 20:47:19.842535 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: warnings.warn(msg) Jul 05 20:47:19.907431 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: INFO nova.api.openstack.requestlog [None req-1d5ef463-8690-4ce5-aef1-3f81c53fd385 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.288926 Jul 05 20:47:19.908202 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: [pid: 103147|app: 0|req: 4/6] 10.222.0.20 () {64 vars in 1335 bytes} [Tue Jul 5 20:47:19 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 20:47:22.034505 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi [None req-e36819e9-4144-4e17-8f3c-61fe06b39998 admin admin] Calling method '>' {{(pid=103148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:47:22.035565 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: INFO nova.api.openstack.requestlog [None req-e36819e9-4144-4e17-8f3c-61fe06b39998 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002047 Jul 05 20:47:22.035974 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: [pid: 103148|app: 0|req: 3/7] 10.222.0.20 () {54 vars in 930 bytes} [Tue Jul 5 20:47:22 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 20:47:22.141231 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi [None req-937446d2-0a4d-422c-9498-44efda95a55b admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds512M", "ram": 512, "vcpus": 1, "os-flavor-access:is_public": true, "swap": 0, "disk": 5, "rxtx_factor": 1.0, "id": "d1"}} {{(pid=103147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 20:47:22.160356 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 05 20:47:22.160356 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: warnings.warn(msg) Jul 05 20:47:22.178660 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: INFO nova.api.openstack.requestlog [None req-937446d2-0a4d-422c-9498-44efda95a55b admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.136724 Jul 05 20:47:22.179212 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: [pid: 103147|app: 0|req: 5/8] 10.222.0.20 () {64 vars in 1282 bytes} [Tue Jul 5 20:47:22 2022] POST /compute/v2.1/flavors => generated 404 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 05 20:47:22.191075 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi [None req-7d771fd0-4aa8-464c-840b-bace47574221 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 20:47:22.192549 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 05 20:47:22.192549 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: warnings.warn(msg) Jul 05 20:47:22.225231 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: INFO nova.api.openstack.requestlog [None req-7d771fd0-4aa8-464c-840b-bace47574221 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.037650 Jul 05 20:47:22.225727 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: [pid: 103148|app: 0|req: 4/9] 10.222.0.20 () {64 vars in 1335 bytes} [Tue Jul 5 20:47:22 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 20:47:24.318401 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi [None req-937446d2-0a4d-422c-9498-44efda95a55b admin admin] Calling method '>' {{(pid=103147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:47:24.319695 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: INFO nova.api.openstack.requestlog [None req-937446d2-0a4d-422c-9498-44efda95a55b admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001793 Jul 05 20:47:24.320379 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: [pid: 103147|app: 0|req: 6/10] 10.222.0.20 () {54 vars in 930 bytes} [Tue Jul 5 20:47:24 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 20:47:24.380798 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi [None req-280ef0d2-ed2f-40da-a3cb-d4f6a94c9402 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds1G", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "disk": 10, "vcpus": 1, "ram": 1024, "id": "d2", "rxtx_factor": 1.0, "swap": 0}} {{(pid=103148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 20:47:24.400036 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: INFO nova.api.openstack.requestlog [None req-280ef0d2-ed2f-40da-a3cb-d4f6a94c9402 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.073639 Jul 05 20:47:24.400772 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: [pid: 103148|app: 0|req: 5/11] 10.222.0.20 () {64 vars in 1282 bytes} [Tue Jul 5 20:47:24 2022] POST /compute/v2.1/flavors => generated 404 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 05 20:47:24.412623 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi [None req-15dc32a9-3aa3-4100-993c-bbc4df6846dd admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 20:47:24.441432 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: INFO nova.api.openstack.requestlog [None req-15dc32a9-3aa3-4100-993c-bbc4df6846dd admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032340 Jul 05 20:47:24.442187 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: [pid: 103147|app: 0|req: 7/12] 10.222.0.20 () {64 vars in 1335 bytes} [Tue Jul 5 20:47:24 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 20:47:26.550937 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi [None req-280ef0d2-ed2f-40da-a3cb-d4f6a94c9402 admin admin] Calling method '>' {{(pid=103148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:47:26.552000 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: INFO nova.api.openstack.requestlog [None req-280ef0d2-ed2f-40da-a3cb-d4f6a94c9402 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002508 Jul 05 20:47:26.552403 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: [pid: 103148|app: 0|req: 6/13] 10.222.0.20 () {54 vars in 930 bytes} [Tue Jul 5 20:47:26 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 20:47:26.613279 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi [None req-d7955f08-5881-488f-8e0a-c48949e22dc5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "disk": 10, "rxtx_factor": 1.0, "id": "d3", "swap": 0, "name": "ds2G", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "vcpus": 2}} {{(pid=103147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 20:47:26.631022 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: INFO nova.api.openstack.requestlog [None req-d7955f08-5881-488f-8e0a-c48949e22dc5 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.072797 Jul 05 20:47:26.631575 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: [pid: 103147|app: 0|req: 8/14] 10.222.0.20 () {64 vars in 1282 bytes} [Tue Jul 5 20:47:26 2022] POST /compute/v2.1/flavors => generated 404 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 05 20:47:26.643944 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi [None req-197a8c51-499b-4ba7-86de-a5e2f28fb3e5 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 20:47:26.669658 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: INFO nova.api.openstack.requestlog [None req-197a8c51-499b-4ba7-86de-a5e2f28fb3e5 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029701 Jul 05 20:47:26.670724 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: [pid: 103148|app: 0|req: 7/15] 10.222.0.20 () {64 vars in 1335 bytes} [Tue Jul 5 20:47:26 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 20:47:28.758275 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi [None req-d7955f08-5881-488f-8e0a-c48949e22dc5 admin admin] Calling method '>' {{(pid=103147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:47:28.759283 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: INFO nova.api.openstack.requestlog [None req-d7955f08-5881-488f-8e0a-c48949e22dc5 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001449 Jul 05 20:47:28.759840 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: [pid: 103147|app: 0|req: 9/16] 10.222.0.20 () {54 vars in 930 bytes} [Tue Jul 5 20:47:28 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 20:47:28.821547 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi [None req-9fd171f8-817e-4aea-a0a6-71c15d467f80 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d4", "name": "ds4G", "disk": 20, "vcpus": 4, "swap": 0, "ram": 4096, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true}} {{(pid=103148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 20:47:28.838818 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: INFO nova.api.openstack.requestlog [None req-9fd171f8-817e-4aea-a0a6-71c15d467f80 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.073103 Jul 05 20:47:28.839384 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: [pid: 103148|app: 0|req: 8/17] 10.222.0.20 () {64 vars in 1282 bytes} [Tue Jul 5 20:47:28 2022] POST /compute/v2.1/flavors => generated 404 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 05 20:47:28.851256 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi [None req-ccfd97cf-42b2-4813-b8f4-7100ff466934 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 20:47:28.873359 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: INFO nova.api.openstack.requestlog [None req-ccfd97cf-42b2-4813-b8f4-7100ff466934 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.025847 Jul 05 20:47:28.874475 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: [pid: 103147|app: 0|req: 10/18] 10.222.0.20 () {64 vars in 1335 bytes} [Tue Jul 5 20:47:28 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 20:47:30.993704 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi [None req-9fd171f8-817e-4aea-a0a6-71c15d467f80 admin admin] Calling method '>' {{(pid=103148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:47:30.995301 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: INFO nova.api.openstack.requestlog [None req-9fd171f8-817e-4aea-a0a6-71c15d467f80 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002042 Jul 05 20:47:30.995707 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: [pid: 103148|app: 0|req: 9/19] 10.222.0.20 () {54 vars in 930 bytes} [Tue Jul 5 20:47:30 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 20:47:31.057364 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi [None req-08ac1543-8b4f-4150-9720-922ac32c03bd admin admin] Calling method '>' {{(pid=103147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:47:31.081397 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: INFO nova.api.openstack.requestlog [None req-08ac1543-8b4f-4150-9720-922ac32c03bd admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.078969 Jul 05 20:47:31.082058 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: [pid: 103147|app: 0|req: 11/20] 10.222.0.20 () {60 vars in 1291 bytes} [Tue Jul 5 20:47:31 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 20:47:33.187272 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi [None req-9fd171f8-817e-4aea-a0a6-71c15d467f80 admin admin] Calling method '>' {{(pid=103148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:47:33.187272 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: INFO nova.api.openstack.requestlog [None req-9fd171f8-817e-4aea-a0a6-71c15d467f80 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001502 Jul 05 20:47:33.187913 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: [pid: 103148|app: 0|req: 10/21] 10.222.0.20 () {54 vars in 930 bytes} [Tue Jul 5 20:47:33 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 20:47:33.247856 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi [None req-ff9afb1e-dd15-4187-9f76-a29fbde5e069 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "ram": 512, "id": "1", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "disk": 1, "swap": 0, "name": "m1.tiny"}} {{(pid=103147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 20:47:33.268754 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: INFO nova.api.openstack.requestlog [None req-ff9afb1e-dd15-4187-9f76-a29fbde5e069 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.074368 Jul 05 20:47:33.269394 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: [pid: 103147|app: 0|req: 12/22] 10.222.0.20 () {64 vars in 1282 bytes} [Tue Jul 5 20:47:33 2022] POST /compute/v2.1/flavors => generated 402 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 05 20:47:33.284509 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi [None req-efe734c4-d82a-4000-9740-fa523ee38069 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 20:47:33.313591 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: INFO nova.api.openstack.requestlog [None req-efe734c4-d82a-4000-9740-fa523ee38069 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034534 Jul 05 20:47:33.314176 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: [pid: 103148|app: 0|req: 11/23] 10.222.0.20 () {64 vars in 1332 bytes} [Tue Jul 5 20:47:33 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 20:47:35.445227 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi [None req-ff9afb1e-dd15-4187-9f76-a29fbde5e069 admin admin] Calling method '>' {{(pid=103147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:47:35.446581 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: INFO nova.api.openstack.requestlog [None req-ff9afb1e-dd15-4187-9f76-a29fbde5e069 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002018 Jul 05 20:47:35.447140 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: [pid: 103147|app: 0|req: 13/24] 10.222.0.20 () {54 vars in 930 bytes} [Tue Jul 5 20:47:35 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 20:47:35.507697 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi [None req-8714acb9-ea9f-4801-9a58-f487bb2f30a2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.small", "OS-FLV-EXT-DATA:ephemeral": 0, "id": "2", "rxtx_factor": 1.0, "ram": 2048, "swap": 0, "os-flavor-access:is_public": true, "disk": 20, "vcpus": 1}} {{(pid=103148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 20:47:35.525146 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: INFO nova.api.openstack.requestlog [None req-8714acb9-ea9f-4801-9a58-f487bb2f30a2 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.072098 Jul 05 20:47:35.525827 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: [pid: 103148|app: 0|req: 12/25] 10.222.0.20 () {64 vars in 1282 bytes} [Tue Jul 5 20:47:35 2022] POST /compute/v2.1/flavors => generated 405 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 05 20:47:35.539821 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi [None req-cbfac3ae-3659-464e-91b1-8cc0d50642d0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 20:47:35.569133 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: INFO nova.api.openstack.requestlog [None req-cbfac3ae-3659-464e-91b1-8cc0d50642d0 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034091 Jul 05 20:47:35.569854 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: [pid: 103147|app: 0|req: 14/26] 10.222.0.20 () {64 vars in 1332 bytes} [Tue Jul 5 20:47:35 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 20:47:37.754870 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi [None req-8714acb9-ea9f-4801-9a58-f487bb2f30a2 admin admin] Calling method '>' {{(pid=103148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:47:37.755894 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: INFO nova.api.openstack.requestlog [None req-8714acb9-ea9f-4801-9a58-f487bb2f30a2 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001523 Jul 05 20:47:37.756359 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: [pid: 103148|app: 0|req: 13/27] 10.222.0.20 () {54 vars in 930 bytes} [Tue Jul 5 20:47:37 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 20:47:37.817096 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi [None req-add6a97f-8bfd-47eb-89e3-24d7f675c448 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "swap": 0, "name": "m1.medium", "vcpus": 2, "id": "3", "ram": 4096, "disk": 40}} {{(pid=103147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 20:47:37.836128 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: INFO nova.api.openstack.requestlog [None req-add6a97f-8bfd-47eb-89e3-24d7f675c448 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.073465 Jul 05 20:47:37.836678 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: [pid: 103147|app: 0|req: 15/28] 10.222.0.20 () {64 vars in 1282 bytes} [Tue Jul 5 20:47:37 2022] POST /compute/v2.1/flavors => generated 406 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 05 20:47:37.852964 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi [None req-e86bf5a8-cc96-4466-b3c3-2eb9e7716565 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 20:47:37.878156 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: INFO nova.api.openstack.requestlog [None req-e86bf5a8-cc96-4466-b3c3-2eb9e7716565 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030065 Jul 05 20:47:37.878744 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: [pid: 103148|app: 0|req: 14/29] 10.222.0.20 () {64 vars in 1332 bytes} [Tue Jul 5 20:47:37 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 20:47:40.023548 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi [None req-add6a97f-8bfd-47eb-89e3-24d7f675c448 admin admin] Calling method '>' {{(pid=103147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:47:40.024473 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: INFO nova.api.openstack.requestlog [None req-add6a97f-8bfd-47eb-89e3-24d7f675c448 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001449 Jul 05 20:47:40.025065 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: [pid: 103147|app: 0|req: 16/30] 10.222.0.20 () {54 vars in 930 bytes} [Tue Jul 5 20:47:40 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 20:47:40.082746 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi [None req-e356391c-c446-42ce-92ad-b3668a4ccb56 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 4, "name": "m1.large", "swap": 0, "rxtx_factor": 1.0, "id": "4", "os-flavor-access:is_public": true, "disk": 80, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 8192}} {{(pid=103148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 20:47:40.100531 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: INFO nova.api.openstack.requestlog [None req-e356391c-c446-42ce-92ad-b3668a4ccb56 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.069890 Jul 05 20:47:40.101106 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: [pid: 103148|app: 0|req: 15/31] 10.222.0.20 () {64 vars in 1282 bytes} [Tue Jul 5 20:47:40 2022] POST /compute/v2.1/flavors => generated 405 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 05 20:47:40.113315 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi [None req-b51c0c77-622e-40dc-8e11-cddd0ee86a87 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 20:47:40.136518 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: INFO nova.api.openstack.requestlog [None req-b51c0c77-622e-40dc-8e11-cddd0ee86a87 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027448 Jul 05 20:47:40.137372 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: [pid: 103147|app: 0|req: 17/32] 10.222.0.20 () {64 vars in 1332 bytes} [Tue Jul 5 20:47:40 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 20:47:42.244520 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi [None req-e356391c-c446-42ce-92ad-b3668a4ccb56 admin admin] Calling method '>' {{(pid=103148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:47:42.245536 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: INFO nova.api.openstack.requestlog [None req-e356391c-c446-42ce-92ad-b3668a4ccb56 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001549 Jul 05 20:47:42.245943 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: [pid: 103148|app: 0|req: 16/33] 10.222.0.20 () {54 vars in 930 bytes} [Tue Jul 5 20:47:42 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 20:47:42.305619 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi [None req-06b5b5d3-12f5-4343-a7fb-4c50cdc27648 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 8, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "5", "ram": 16384, "rxtx_factor": 1.0, "name": "m1.xlarge", "os-flavor-access:is_public": true, "disk": 160, "swap": 0}} {{(pid=103147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 20:47:42.323116 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: INFO nova.api.openstack.requestlog [None req-06b5b5d3-12f5-4343-a7fb-4c50cdc27648 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.071305 Jul 05 20:47:42.323633 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: [pid: 103147|app: 0|req: 18/34] 10.222.0.20 () {64 vars in 1282 bytes} [Tue Jul 5 20:47:42 2022] POST /compute/v2.1/flavors => generated 408 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 05 20:47:42.336611 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi [None req-22d98f6a-4bdb-403a-b56d-9dab3b40066f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 20:47:42.366995 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: INFO nova.api.openstack.requestlog [None req-22d98f6a-4bdb-403a-b56d-9dab3b40066f admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034042 Jul 05 20:47:42.368092 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: [pid: 103148|app: 0|req: 17/35] 10.222.0.20 () {64 vars in 1332 bytes} [Tue Jul 5 20:47:42 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 20:48:07.208621 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi [None req-06b5b5d3-12f5-4343-a7fb-4c50cdc27648 admin admin] Calling method '>' {{(pid=103147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:48:07.209641 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: INFO nova.api.openstack.requestlog [None req-06b5b5d3-12f5-4343-a7fb-4c50cdc27648 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001440 Jul 05 20:48:07.210027 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: [pid: 103147|app: 0|req: 19/36] 10.222.0.20 () {54 vars in 930 bytes} [Tue Jul 5 20:48:07 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 20:48:07.220886 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG dbcounter [-] [103148] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=10,nova_api:SAVEPOINT=5,nova_api:RELEASE=5 {{(pid=103148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:48:07.273984 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi [None req-f9c715be-cb22-49b6-ae4d-eb6cc99e238c admin admin] Calling method '>' {{(pid=103148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:48:07.291312 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: INFO nova.api.openstack.requestlog [None req-f9c715be-cb22-49b6-ae4d-eb6cc99e238c admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.075417 Jul 05 20:48:07.291855 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: [pid: 103148|app: 0|req: 18/37] 10.222.0.20 () {60 vars in 1291 bytes} [Tue Jul 5 20:48:07 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 20:48:08.213347 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi [None req-06b5b5d3-12f5-4343-a7fb-4c50cdc27648 admin admin] Calling method '>' {{(pid=103147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:48:08.214338 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: INFO nova.api.openstack.requestlog [None req-06b5b5d3-12f5-4343-a7fb-4c50cdc27648 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001447 Jul 05 20:48:08.214729 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: [pid: 103147|app: 0|req: 20/38] 10.222.0.20 () {56 vars in 1074 bytes} [Tue Jul 5 20:48:08 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 20:48:08.403243 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi [None req-fd6b7e52-8bb1-4f8d-aafa-7b0efd74ac7b admin admin] Calling method '>' {{(pid=103148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:48:08.410125 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: INFO nova.api.openstack.wsgi [None req-fd6b7e52-8bb1-4f8d-aafa-7b0efd74ac7b admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 05 20:48:08.413355 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi [None req-fd6b7e52-8bb1-4f8d-aafa-7b0efd74ac7b admin admin] Request method failure captured: Jul 05 20:48:08.413355 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 05 20:48:08.413355 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: Accept: application/json Jul 05 20:48:08.413355 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: Accept-Encoding: gzip, deflate Jul 05 20:48:08.413355 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: Connection: keep-alive Jul 05 20:48:08.413355 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: Content-Length: 0 Jul 05 20:48:08.413355 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: Host: 10.222.0.20 Jul 05 20:48:08.413355 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: Openstack-Api-Version: compute 2.90 Jul 05 20:48:08.413355 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: Openstack-System-Scope: None Jul 05 20:48:08.413355 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: User-Agent: python-novaclient Jul 05 20:48:08.413355 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: X-Auth-Token: gAAAAABixKOIHBAAdX4XpPo-9YA1iOSqDUU1KR_FtgQVDTGyAImjd93JOcTcTJMGBGfTNUaAxU1IxUU2h4sh2Sz-vdoMpu_JdIBizoTcTdjHo_7vsnUdhikvZDoDykC7hZuuhtpZ8mZ2HXW9-YebZGxbCJefTz58wXfGtFATvc-7_DiMYnmMSqQ Jul 05 20:48:08.413355 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: X-Domain-Id: None Jul 05 20:48:08.413355 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: X-Domain-Name: None Jul 05 20:48:08.413355 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: X-Identity-Status: Confirmed Jul 05 20:48:08.413355 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: X-Is-Admin-Project: True Jul 05 20:48:08.413355 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: X-Openstack-Nova-Api-Version: 2.90 Jul 05 20:48:08.413355 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: X-Project-Domain-Id: default Jul 05 20:48:08.413355 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: X-Project-Domain-Name: Default Jul 05 20:48:08.413355 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: X-Project-Id: bc03931f4286458d988d48dd2cd6c224 Jul 05 20:48:08.413355 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: X-Project-Name: admin Jul 05 20:48:08.413355 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: X-Role: member,admin,reader Jul 05 20:48:08.413355 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: X-Roles: member,admin,reader Jul 05 20:48:08.415014 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/bc03931f4286458d988d48dd2cd6c224"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/bc03931f4286458d988d48dd2cd6c224"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_bc03931f4286458d988d48dd2cd6c224"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/bc03931f4286458d988d48dd2cd6c224"}]}] Jul 05 20:48:08.415014 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: X-Tenant: admin Jul 05 20:48:08.415014 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: X-Tenant-Id: bc03931f4286458d988d48dd2cd6c224 Jul 05 20:48:08.415014 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: X-Tenant-Name: admin Jul 05 20:48:08.415014 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: X-User: admin Jul 05 20:48:08.415014 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: X-User-Domain-Id: default Jul 05 20:48:08.415014 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: X-User-Domain-Name: Default Jul 05 20:48:08.415014 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: X-User-Id: 52d40fe0347f4d97acf889a2462a0c46 Jul 05 20:48:08.415014 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: X-User-Name: admin Jul 05 20:48:08.415014 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: method: > Jul 05 20:48:08.415014 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: exception: Flavor 42 could not be found. Jul 05 20:48:08.415014 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: action_args: {'id': '42'} Jul 05 20:48:08.415014 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: {{(pid=103148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 05 20:48:08.415014 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 20:48:08.415914 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 05 20:48:08.415914 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 05 20:48:08.415914 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 05 20:48:08.415914 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 05 20:48:08.415914 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 05 20:48:08.415914 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 05 20:48:08.415914 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 05 20:48:08.415914 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 05 20:48:08.415914 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 05 20:48:08.415914 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 05 20:48:08.415914 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 05 20:48:08.415914 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 05 20:48:08.415914 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 05 20:48:08.415914 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: ERROR nova.api.openstack.wsgi Jul 05 20:48:08.415914 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 20:48:08.415914 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: ERROR nova.api.openstack.wsgi Jul 05 20:48:08.415914 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 20:48:08.415914 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 20:48:08.415914 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 20:48:08.417542 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 05 20:48:08.417542 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 05 20:48:08.417542 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 05 20:48:08.417542 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 05 20:48:08.417542 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 05 20:48:08.417542 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 05 20:48:08.417542 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 05 20:48:08.417542 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: ERROR nova.api.openstack.wsgi Jul 05 20:48:08.417542 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 20:48:08.417542 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: ERROR nova.api.openstack.wsgi Jul 05 20:48:08.417542 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 20:48:08.417542 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 20:48:08.417542 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 20:48:08.417542 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 05 20:48:08.417542 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 05 20:48:08.417542 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 05 20:48:08.417542 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: ERROR nova.api.openstack.wsgi Jul 05 20:48:08.417542 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi [None req-fd6b7e52-8bb1-4f8d-aafa-7b0efd74ac7b admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103148) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 05 20:48:08.418911 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: INFO nova.api.openstack.requestlog [None req-fd6b7e52-8bb1-4f8d-aafa-7b0efd74ac7b admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.063035 Jul 05 20:48:08.418911 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: [pid: 103148|app: 0|req: 19/39] 10.222.0.20 () {60 vars in 1190 bytes} [Tue Jul 5 20:48:08 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 05 20:48:08.425272 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi [None req-9ddddcd4-1a20-4198-b4e6-9473d44e81dd admin admin] Calling method '>' {{(pid=103147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:48:08.428198 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG dbcounter [-] [103147] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=103147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:48:08.447913 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: INFO nova.api.openstack.requestlog [None req-9ddddcd4-1a20-4198-b4e6-9473d44e81dd admin admin] 10.222.0.20 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.027049 Jul 05 20:48:08.448477 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: [pid: 103147|app: 0|req: 21/40] 10.222.0.20 () {60 vars in 1210 bytes} [Tue Jul 5 20:48:08 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 05 20:48:08.458871 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi [None req-001be79a-ad32-4ef0-a976-48cb0030fb4e admin admin] Calling method '>' {{(pid=103148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:48:08.480834 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: INFO nova.api.openstack.requestlog [None req-001be79a-ad32-4ef0-a976-48cb0030fb4e admin admin] 10.222.0.20 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026256 Jul 05 20:48:08.481404 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: [pid: 103148|app: 0|req: 20/41] 10.222.0.20 () {60 vars in 1210 bytes} [Tue Jul 5 20:48:08 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 20:48:08.491994 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi [None req-127175b2-7be4-41c6-b7ad-68c526b98344 admin admin] Calling method '>' {{(pid=103147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:48:08.498283 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: INFO nova.api.openstack.wsgi [None req-127175b2-7be4-41c6-b7ad-68c526b98344 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 05 20:48:08.502011 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi [None req-127175b2-7be4-41c6-b7ad-68c526b98344 admin admin] Request method failure captured: Jul 05 20:48:08.502011 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 05 20:48:08.502011 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: Accept: application/json Jul 05 20:48:08.502011 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: Accept-Encoding: gzip, deflate Jul 05 20:48:08.502011 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: Connection: keep-alive Jul 05 20:48:08.502011 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: Content-Length: 0 Jul 05 20:48:08.502011 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: Host: 10.222.0.20 Jul 05 20:48:08.502011 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: Openstack-Api-Version: compute 2.90 Jul 05 20:48:08.502011 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: Openstack-System-Scope: None Jul 05 20:48:08.502011 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: User-Agent: python-novaclient Jul 05 20:48:08.502011 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: X-Auth-Token: gAAAAABixKOIHBAAdX4XpPo-9YA1iOSqDUU1KR_FtgQVDTGyAImjd93JOcTcTJMGBGfTNUaAxU1IxUU2h4sh2Sz-vdoMpu_JdIBizoTcTdjHo_7vsnUdhikvZDoDykC7hZuuhtpZ8mZ2HXW9-YebZGxbCJefTz58wXfGtFATvc-7_DiMYnmMSqQ Jul 05 20:48:08.502011 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: X-Domain-Id: None Jul 05 20:48:08.502011 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: X-Domain-Name: None Jul 05 20:48:08.502011 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: X-Identity-Status: Confirmed Jul 05 20:48:08.502011 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: X-Is-Admin-Project: True Jul 05 20:48:08.502011 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: X-Openstack-Nova-Api-Version: 2.90 Jul 05 20:48:08.502011 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: X-Project-Domain-Id: default Jul 05 20:48:08.502011 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: X-Project-Domain-Name: Default Jul 05 20:48:08.502011 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: X-Project-Id: bc03931f4286458d988d48dd2cd6c224 Jul 05 20:48:08.502011 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: X-Project-Name: admin Jul 05 20:48:08.502011 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: X-Role: member,admin,reader Jul 05 20:48:08.502011 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: X-Roles: member,admin,reader Jul 05 20:48:08.503567 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/bc03931f4286458d988d48dd2cd6c224"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/bc03931f4286458d988d48dd2cd6c224"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_bc03931f4286458d988d48dd2cd6c224"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/bc03931f4286458d988d48dd2cd6c224"}]}] Jul 05 20:48:08.503567 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: X-Tenant: admin Jul 05 20:48:08.503567 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: X-Tenant-Id: bc03931f4286458d988d48dd2cd6c224 Jul 05 20:48:08.503567 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: X-Tenant-Name: admin Jul 05 20:48:08.503567 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: X-User: admin Jul 05 20:48:08.503567 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: X-User-Domain-Id: default Jul 05 20:48:08.503567 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: X-User-Domain-Name: Default Jul 05 20:48:08.503567 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: X-User-Id: 52d40fe0347f4d97acf889a2462a0c46 Jul 05 20:48:08.503567 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: X-User-Name: admin Jul 05 20:48:08.503567 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: method: > Jul 05 20:48:08.503567 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: exception: Flavor 42 could not be found. Jul 05 20:48:08.503567 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: action_args: {'id': '42'} Jul 05 20:48:08.503567 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: {{(pid=103147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 05 20:48:08.503567 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 20:48:08.504459 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 05 20:48:08.504459 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 05 20:48:08.504459 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 05 20:48:08.504459 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 05 20:48:08.504459 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 05 20:48:08.504459 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 05 20:48:08.504459 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 05 20:48:08.504459 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 05 20:48:08.504459 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 05 20:48:08.504459 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 05 20:48:08.504459 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 05 20:48:08.504459 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 05 20:48:08.504459 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 05 20:48:08.504459 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi Jul 05 20:48:08.504459 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 20:48:08.504459 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi Jul 05 20:48:08.504459 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 20:48:08.504459 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 20:48:08.504459 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 20:48:08.505597 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 05 20:48:08.505597 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 05 20:48:08.505597 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 05 20:48:08.505597 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 05 20:48:08.505597 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 05 20:48:08.505597 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 05 20:48:08.505597 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 05 20:48:08.505597 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi Jul 05 20:48:08.505597 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 20:48:08.505597 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi Jul 05 20:48:08.505597 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 20:48:08.505597 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 20:48:08.505597 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 20:48:08.505597 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 05 20:48:08.505597 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 05 20:48:08.505597 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 05 20:48:08.505597 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi Jul 05 20:48:08.505597 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi [None req-127175b2-7be4-41c6-b7ad-68c526b98344 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103147) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 05 20:48:08.506652 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: INFO nova.api.openstack.requestlog [None req-127175b2-7be4-41c6-b7ad-68c526b98344 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.014940 Jul 05 20:48:08.506652 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: [pid: 103147|app: 0|req: 22/42] 10.222.0.20 () {60 vars in 1190 bytes} [Tue Jul 5 20:48:08 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 05 20:48:09.325956 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi [None req-001be79a-ad32-4ef0-a976-48cb0030fb4e admin admin] Calling method '>' {{(pid=103148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:48:09.326968 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: INFO nova.api.openstack.requestlog [None req-001be79a-ad32-4ef0-a976-48cb0030fb4e admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001432 Jul 05 20:48:09.327359 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: [pid: 103148|app: 0|req: 21/43] 10.222.0.20 () {56 vars in 1074 bytes} [Tue Jul 5 20:48:09 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 20:48:09.518007 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi [None req-78061887-f381-4b71-a580-8c6b91adfd29 admin admin] Calling method '>' {{(pid=103147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:48:09.523943 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: INFO nova.api.openstack.wsgi [None req-78061887-f381-4b71-a580-8c6b91adfd29 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 05 20:48:09.525511 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi [None req-78061887-f381-4b71-a580-8c6b91adfd29 admin admin] Request method failure captured: Jul 05 20:48:09.525511 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 05 20:48:09.525511 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: Accept: application/json Jul 05 20:48:09.525511 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: Accept-Encoding: gzip, deflate Jul 05 20:48:09.525511 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: Connection: keep-alive Jul 05 20:48:09.525511 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: Content-Length: 0 Jul 05 20:48:09.525511 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: Host: 10.222.0.20 Jul 05 20:48:09.525511 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: Openstack-Api-Version: compute 2.90 Jul 05 20:48:09.525511 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: Openstack-System-Scope: None Jul 05 20:48:09.525511 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: User-Agent: python-novaclient Jul 05 20:48:09.525511 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: X-Auth-Token: gAAAAABixKOJxhrqSVvIAI3RUENoJEkLerTdg_qkmnY0UuKBMU8VGnz8aABPF9RqfIt_sSdJ7Y88ENkCpYhxmKdDdLtpR-AbppC_0IhDw0YeimvU1F6F2n4vvm9mwXfZAdX6TLRIxNvHiHOo-bHjEe3Cyy2-SEgbivHcAml74YuPFnQhGqb9uPc Jul 05 20:48:09.525511 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: X-Domain-Id: None Jul 05 20:48:09.525511 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: X-Domain-Name: None Jul 05 20:48:09.525511 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: X-Identity-Status: Confirmed Jul 05 20:48:09.525511 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: X-Is-Admin-Project: True Jul 05 20:48:09.525511 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: X-Openstack-Nova-Api-Version: 2.90 Jul 05 20:48:09.525511 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: X-Project-Domain-Id: default Jul 05 20:48:09.525511 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: X-Project-Domain-Name: Default Jul 05 20:48:09.525511 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: X-Project-Id: bc03931f4286458d988d48dd2cd6c224 Jul 05 20:48:09.525511 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: X-Project-Name: admin Jul 05 20:48:09.525511 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: X-Role: member,admin,reader Jul 05 20:48:09.525511 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: X-Roles: member,admin,reader Jul 05 20:48:09.527069 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/bc03931f4286458d988d48dd2cd6c224"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/bc03931f4286458d988d48dd2cd6c224"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_bc03931f4286458d988d48dd2cd6c224"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/bc03931f4286458d988d48dd2cd6c224"}]}] Jul 05 20:48:09.527069 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: X-Tenant: admin Jul 05 20:48:09.527069 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: X-Tenant-Id: bc03931f4286458d988d48dd2cd6c224 Jul 05 20:48:09.527069 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: X-Tenant-Name: admin Jul 05 20:48:09.527069 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: X-User: admin Jul 05 20:48:09.527069 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: X-User-Domain-Id: default Jul 05 20:48:09.527069 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: X-User-Domain-Name: Default Jul 05 20:48:09.527069 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: X-User-Id: 52d40fe0347f4d97acf889a2462a0c46 Jul 05 20:48:09.527069 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: X-User-Name: admin Jul 05 20:48:09.527069 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: method: > Jul 05 20:48:09.527069 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: exception: Flavor 84 could not be found. Jul 05 20:48:09.527069 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: action_args: {'id': '84'} Jul 05 20:48:09.527069 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: {{(pid=103147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 05 20:48:09.527069 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 20:48:09.528055 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 05 20:48:09.528055 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 05 20:48:09.528055 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 05 20:48:09.528055 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 05 20:48:09.528055 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 05 20:48:09.528055 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 05 20:48:09.528055 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 05 20:48:09.528055 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 05 20:48:09.528055 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 05 20:48:09.528055 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 05 20:48:09.528055 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 05 20:48:09.528055 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 05 20:48:09.528055 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 05 20:48:09.528055 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi Jul 05 20:48:09.528055 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 20:48:09.528055 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi Jul 05 20:48:09.528055 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 20:48:09.528055 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 20:48:09.528055 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 20:48:09.529418 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 05 20:48:09.529418 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 05 20:48:09.529418 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 05 20:48:09.529418 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 05 20:48:09.529418 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 05 20:48:09.529418 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 05 20:48:09.529418 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 05 20:48:09.529418 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi Jul 05 20:48:09.529418 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 20:48:09.529418 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi Jul 05 20:48:09.529418 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 20:48:09.529418 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 20:48:09.529418 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 20:48:09.529418 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 05 20:48:09.529418 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 05 20:48:09.529418 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 05 20:48:09.529418 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi Jul 05 20:48:09.529418 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi [None req-78061887-f381-4b71-a580-8c6b91adfd29 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103147) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 05 20:48:09.531000 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: INFO nova.api.openstack.requestlog [None req-78061887-f381-4b71-a580-8c6b91adfd29 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.061172 Jul 05 20:48:09.531000 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: [pid: 103147|app: 0|req: 23/44] 10.222.0.20 () {60 vars in 1190 bytes} [Tue Jul 5 20:48:09 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 05 20:48:09.537309 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi [None req-ec6268ea-0852-462c-a212-1c29e44b0530 admin admin] Calling method '>' {{(pid=103148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:48:09.551260 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: INFO nova.api.openstack.requestlog [None req-ec6268ea-0852-462c-a212-1c29e44b0530 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017607 Jul 05 20:48:09.551774 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: [pid: 103148|app: 0|req: 22/45] 10.222.0.20 () {60 vars in 1210 bytes} [Tue Jul 5 20:48:09 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 05 20:48:09.561115 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi [None req-f49b66bc-7a49-46a3-86ed-bc39173086e3 admin admin] Calling method '>' {{(pid=103147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:48:09.575232 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: INFO nova.api.openstack.requestlog [None req-f49b66bc-7a49-46a3-86ed-bc39173086e3 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017654 Jul 05 20:48:09.575758 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: [pid: 103147|app: 0|req: 24/46] 10.222.0.20 () {60 vars in 1210 bytes} [Tue Jul 5 20:48:09 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 05 20:48:09.585218 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi [None req-532b4560-d564-4d4a-a55c-075df3afd976 admin admin] Calling method '>' {{(pid=103148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:48:09.590485 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: INFO nova.api.openstack.wsgi [None req-532b4560-d564-4d4a-a55c-075df3afd976 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 05 20:48:09.591989 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi [None req-532b4560-d564-4d4a-a55c-075df3afd976 admin admin] Request method failure captured: Jul 05 20:48:09.591989 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 05 20:48:09.591989 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: Accept: application/json Jul 05 20:48:09.591989 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: Accept-Encoding: gzip, deflate Jul 05 20:48:09.591989 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: Connection: keep-alive Jul 05 20:48:09.591989 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: Content-Length: 0 Jul 05 20:48:09.591989 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: Host: 10.222.0.20 Jul 05 20:48:09.591989 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: Openstack-Api-Version: compute 2.90 Jul 05 20:48:09.591989 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: Openstack-System-Scope: None Jul 05 20:48:09.591989 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: User-Agent: python-novaclient Jul 05 20:48:09.591989 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: X-Auth-Token: gAAAAABixKOJxhrqSVvIAI3RUENoJEkLerTdg_qkmnY0UuKBMU8VGnz8aABPF9RqfIt_sSdJ7Y88ENkCpYhxmKdDdLtpR-AbppC_0IhDw0YeimvU1F6F2n4vvm9mwXfZAdX6TLRIxNvHiHOo-bHjEe3Cyy2-SEgbivHcAml74YuPFnQhGqb9uPc Jul 05 20:48:09.591989 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: X-Domain-Id: None Jul 05 20:48:09.591989 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: X-Domain-Name: None Jul 05 20:48:09.591989 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: X-Identity-Status: Confirmed Jul 05 20:48:09.591989 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: X-Is-Admin-Project: True Jul 05 20:48:09.591989 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: X-Openstack-Nova-Api-Version: 2.90 Jul 05 20:48:09.591989 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: X-Project-Domain-Id: default Jul 05 20:48:09.591989 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: X-Project-Domain-Name: Default Jul 05 20:48:09.591989 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: X-Project-Id: bc03931f4286458d988d48dd2cd6c224 Jul 05 20:48:09.591989 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: X-Project-Name: admin Jul 05 20:48:09.591989 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: X-Role: member,admin,reader Jul 05 20:48:09.591989 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: X-Roles: member,admin,reader Jul 05 20:48:09.593603 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/bc03931f4286458d988d48dd2cd6c224"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/bc03931f4286458d988d48dd2cd6c224"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_bc03931f4286458d988d48dd2cd6c224"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/bc03931f4286458d988d48dd2cd6c224"}]}] Jul 05 20:48:09.593603 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: X-Tenant: admin Jul 05 20:48:09.593603 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: X-Tenant-Id: bc03931f4286458d988d48dd2cd6c224 Jul 05 20:48:09.593603 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: X-Tenant-Name: admin Jul 05 20:48:09.593603 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: X-User: admin Jul 05 20:48:09.593603 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: X-User-Domain-Id: default Jul 05 20:48:09.593603 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: X-User-Domain-Name: Default Jul 05 20:48:09.593603 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: X-User-Id: 52d40fe0347f4d97acf889a2462a0c46 Jul 05 20:48:09.593603 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: X-User-Name: admin Jul 05 20:48:09.593603 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: method: > Jul 05 20:48:09.593603 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: exception: Flavor 84 could not be found. Jul 05 20:48:09.593603 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: action_args: {'id': '84'} Jul 05 20:48:09.593603 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: {{(pid=103148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 05 20:48:09.593603 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 20:48:09.594728 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 05 20:48:09.594728 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 05 20:48:09.594728 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 05 20:48:09.594728 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 05 20:48:09.594728 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 05 20:48:09.594728 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 05 20:48:09.594728 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 05 20:48:09.594728 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 05 20:48:09.594728 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 05 20:48:09.594728 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 05 20:48:09.594728 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 05 20:48:09.594728 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 05 20:48:09.594728 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 05 20:48:09.594728 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: ERROR nova.api.openstack.wsgi Jul 05 20:48:09.594728 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 20:48:09.594728 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: ERROR nova.api.openstack.wsgi Jul 05 20:48:09.594728 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 20:48:09.594728 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 20:48:09.594728 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 20:48:09.596051 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 05 20:48:09.596051 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 05 20:48:09.596051 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 05 20:48:09.596051 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 05 20:48:09.596051 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 05 20:48:09.596051 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 05 20:48:09.596051 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 05 20:48:09.596051 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: ERROR nova.api.openstack.wsgi Jul 05 20:48:09.596051 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 20:48:09.596051 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: ERROR nova.api.openstack.wsgi Jul 05 20:48:09.596051 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 20:48:09.596051 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 20:48:09.596051 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 20:48:09.596051 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 05 20:48:09.596051 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 05 20:48:09.596051 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 05 20:48:09.596051 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: ERROR nova.api.openstack.wsgi Jul 05 20:48:09.596051 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi [None req-532b4560-d564-4d4a-a55c-075df3afd976 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103148) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 05 20:48:09.597371 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: INFO nova.api.openstack.requestlog [None req-532b4560-d564-4d4a-a55c-075df3afd976 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.011814 Jul 05 20:48:09.597371 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: [pid: 103148|app: 0|req: 23/47] 10.222.0.20 () {60 vars in 1190 bytes} [Tue Jul 5 20:48:09 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 05 20:48:10.413380 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi [None req-f49b66bc-7a49-46a3-86ed-bc39173086e3 admin admin] Calling method '>' {{(pid=103147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:48:10.414390 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: INFO nova.api.openstack.requestlog [None req-f49b66bc-7a49-46a3-86ed-bc39173086e3 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001510 Jul 05 20:48:10.414787 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: [pid: 103147|app: 0|req: 25/48] 10.222.0.20 () {56 vars in 1074 bytes} [Tue Jul 5 20:48:10 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 20:48:10.603700 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi [None req-f73504a7-ba76-4587-9cc2-32c98c356b38 admin admin] Calling method '>' {{(pid=103148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:48:10.609481 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: INFO nova.api.openstack.wsgi [None req-f73504a7-ba76-4587-9cc2-32c98c356b38 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 05 20:48:10.611732 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi [None req-f73504a7-ba76-4587-9cc2-32c98c356b38 admin admin] Request method failure captured: Jul 05 20:48:10.611732 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 05 20:48:10.611732 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: Accept: application/json Jul 05 20:48:10.611732 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: Accept-Encoding: gzip, deflate Jul 05 20:48:10.611732 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: Connection: keep-alive Jul 05 20:48:10.611732 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: Content-Length: 0 Jul 05 20:48:10.611732 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: Host: 10.222.0.20 Jul 05 20:48:10.611732 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: Openstack-Api-Version: compute 2.90 Jul 05 20:48:10.611732 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: Openstack-System-Scope: None Jul 05 20:48:10.611732 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: User-Agent: python-novaclient Jul 05 20:48:10.611732 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: X-Auth-Token: gAAAAABixKOK5R0EGBWekbvI_fNvZngvlTP9RtefDofZVJ-OBqdElBkgSetojSi2qh-V0o1MwE7EVxv5qkL8PNUOJuxMBP6m3v99Ni-p3Kn6faa3Pl5qWPjW6aaqlzZzEJUr4RisnXtvv41Yv4QAP6NI6lq4OCGWwf-nzWIx2ia24ukIfoX45jI Jul 05 20:48:10.611732 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: X-Domain-Id: None Jul 05 20:48:10.611732 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: X-Domain-Name: None Jul 05 20:48:10.611732 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: X-Identity-Status: Confirmed Jul 05 20:48:10.611732 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: X-Is-Admin-Project: True Jul 05 20:48:10.611732 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: X-Openstack-Nova-Api-Version: 2.90 Jul 05 20:48:10.611732 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: X-Project-Domain-Id: default Jul 05 20:48:10.611732 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: X-Project-Domain-Name: Default Jul 05 20:48:10.611732 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: X-Project-Id: bc03931f4286458d988d48dd2cd6c224 Jul 05 20:48:10.611732 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: X-Project-Name: admin Jul 05 20:48:10.611732 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: X-Role: member,admin,reader Jul 05 20:48:10.611732 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: X-Roles: member,admin,reader Jul 05 20:48:10.613337 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/bc03931f4286458d988d48dd2cd6c224"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/bc03931f4286458d988d48dd2cd6c224"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_bc03931f4286458d988d48dd2cd6c224"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/bc03931f4286458d988d48dd2cd6c224"}]}] Jul 05 20:48:10.613337 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: X-Tenant: admin Jul 05 20:48:10.613337 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: X-Tenant-Id: bc03931f4286458d988d48dd2cd6c224 Jul 05 20:48:10.613337 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: X-Tenant-Name: admin Jul 05 20:48:10.613337 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: X-User: admin Jul 05 20:48:10.613337 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: X-User-Domain-Id: default Jul 05 20:48:10.613337 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: X-User-Domain-Name: Default Jul 05 20:48:10.613337 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: X-User-Id: 52d40fe0347f4d97acf889a2462a0c46 Jul 05 20:48:10.613337 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: X-User-Name: admin Jul 05 20:48:10.613337 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: method: > Jul 05 20:48:10.613337 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: exception: Flavor 451 could not be found. Jul 05 20:48:10.613337 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: action_args: {'id': '451'} Jul 05 20:48:10.613337 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: {{(pid=103148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 05 20:48:10.613337 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 20:48:10.614325 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 05 20:48:10.614325 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 05 20:48:10.614325 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 05 20:48:10.614325 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 05 20:48:10.614325 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 05 20:48:10.614325 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 05 20:48:10.614325 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 05 20:48:10.614325 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 05 20:48:10.614325 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 05 20:48:10.614325 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 05 20:48:10.614325 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 05 20:48:10.614325 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 05 20:48:10.614325 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 05 20:48:10.614325 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: ERROR nova.api.openstack.wsgi Jul 05 20:48:10.614325 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 20:48:10.614325 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: ERROR nova.api.openstack.wsgi Jul 05 20:48:10.614325 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 20:48:10.614325 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 20:48:10.614325 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 20:48:10.615696 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 05 20:48:10.615696 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 05 20:48:10.615696 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 05 20:48:10.615696 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 05 20:48:10.615696 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 05 20:48:10.615696 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 05 20:48:10.615696 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 05 20:48:10.615696 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: ERROR nova.api.openstack.wsgi Jul 05 20:48:10.615696 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 20:48:10.615696 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: ERROR nova.api.openstack.wsgi Jul 05 20:48:10.615696 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 20:48:10.615696 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 20:48:10.615696 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 20:48:10.615696 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 05 20:48:10.615696 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 05 20:48:10.615696 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 05 20:48:10.615696 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: ERROR nova.api.openstack.wsgi Jul 05 20:48:10.615696 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi [None req-f73504a7-ba76-4587-9cc2-32c98c356b38 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103148) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 05 20:48:10.616963 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: INFO nova.api.openstack.requestlog [None req-f73504a7-ba76-4587-9cc2-32c98c356b38 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.060742 Jul 05 20:48:10.616963 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: [pid: 103148|app: 0|req: 24/49] 10.222.0.20 () {60 vars in 1193 bytes} [Tue Jul 5 20:48:10 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 05 20:48:10.622888 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi [None req-b3672134-7194-4990-b872-1b1e7b003b10 admin admin] Calling method '>' {{(pid=103147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:48:10.636509 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: INFO nova.api.openstack.requestlog [None req-b3672134-7194-4990-b872-1b1e7b003b10 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017395 Jul 05 20:48:10.637054 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: [pid: 103147|app: 0|req: 26/50] 10.222.0.20 () {60 vars in 1210 bytes} [Tue Jul 5 20:48:10 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 20:48:10.646248 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi [None req-39b6ce63-d4be-469c-84d5-9d99ff2d4954 admin admin] Calling method '>' {{(pid=103148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:48:10.661970 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: INFO nova.api.openstack.requestlog [None req-39b6ce63-d4be-469c-84d5-9d99ff2d4954 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019116 Jul 05 20:48:10.662501 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: [pid: 103148|app: 0|req: 25/51] 10.222.0.20 () {60 vars in 1210 bytes} [Tue Jul 5 20:48:10 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 20:48:10.671582 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi [None req-6d5aa57e-9178-4a6b-9bd1-103296ee0bb4 admin admin] Calling method '>' {{(pid=103147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:48:10.677581 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: INFO nova.api.openstack.wsgi [None req-6d5aa57e-9178-4a6b-9bd1-103296ee0bb4 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 05 20:48:10.679083 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi [None req-6d5aa57e-9178-4a6b-9bd1-103296ee0bb4 admin admin] Request method failure captured: Jul 05 20:48:10.679083 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 05 20:48:10.679083 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: Accept: application/json Jul 05 20:48:10.679083 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: Accept-Encoding: gzip, deflate Jul 05 20:48:10.679083 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: Connection: keep-alive Jul 05 20:48:10.679083 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: Content-Length: 0 Jul 05 20:48:10.679083 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: Host: 10.222.0.20 Jul 05 20:48:10.679083 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: Openstack-Api-Version: compute 2.90 Jul 05 20:48:10.679083 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: Openstack-System-Scope: None Jul 05 20:48:10.679083 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: User-Agent: python-novaclient Jul 05 20:48:10.679083 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: X-Auth-Token: gAAAAABixKOK5R0EGBWekbvI_fNvZngvlTP9RtefDofZVJ-OBqdElBkgSetojSi2qh-V0o1MwE7EVxv5qkL8PNUOJuxMBP6m3v99Ni-p3Kn6faa3Pl5qWPjW6aaqlzZzEJUr4RisnXtvv41Yv4QAP6NI6lq4OCGWwf-nzWIx2ia24ukIfoX45jI Jul 05 20:48:10.679083 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: X-Domain-Id: None Jul 05 20:48:10.679083 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: X-Domain-Name: None Jul 05 20:48:10.679083 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: X-Identity-Status: Confirmed Jul 05 20:48:10.679083 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: X-Is-Admin-Project: True Jul 05 20:48:10.679083 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: X-Openstack-Nova-Api-Version: 2.90 Jul 05 20:48:10.679083 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: X-Project-Domain-Id: default Jul 05 20:48:10.679083 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: X-Project-Domain-Name: Default Jul 05 20:48:10.679083 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: X-Project-Id: bc03931f4286458d988d48dd2cd6c224 Jul 05 20:48:10.679083 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: X-Project-Name: admin Jul 05 20:48:10.679083 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: X-Role: member,admin,reader Jul 05 20:48:10.679083 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: X-Roles: member,admin,reader Jul 05 20:48:10.680612 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/bc03931f4286458d988d48dd2cd6c224"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/bc03931f4286458d988d48dd2cd6c224"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_bc03931f4286458d988d48dd2cd6c224"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/bc03931f4286458d988d48dd2cd6c224"}]}] Jul 05 20:48:10.680612 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: X-Tenant: admin Jul 05 20:48:10.680612 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: X-Tenant-Id: bc03931f4286458d988d48dd2cd6c224 Jul 05 20:48:10.680612 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: X-Tenant-Name: admin Jul 05 20:48:10.680612 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: X-User: admin Jul 05 20:48:10.680612 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: X-User-Domain-Id: default Jul 05 20:48:10.680612 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: X-User-Domain-Name: Default Jul 05 20:48:10.680612 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: X-User-Id: 52d40fe0347f4d97acf889a2462a0c46 Jul 05 20:48:10.680612 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: X-User-Name: admin Jul 05 20:48:10.680612 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: method: > Jul 05 20:48:10.680612 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: exception: Flavor 451 could not be found. Jul 05 20:48:10.680612 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: action_args: {'id': '451'} Jul 05 20:48:10.680612 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: {{(pid=103147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 05 20:48:10.680612 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 20:48:10.681591 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 05 20:48:10.681591 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 05 20:48:10.681591 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 05 20:48:10.681591 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 05 20:48:10.681591 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 05 20:48:10.681591 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 05 20:48:10.681591 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 05 20:48:10.681591 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 05 20:48:10.681591 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 05 20:48:10.681591 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 05 20:48:10.681591 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 05 20:48:10.681591 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 05 20:48:10.681591 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 05 20:48:10.681591 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi Jul 05 20:48:10.681591 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 20:48:10.681591 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi Jul 05 20:48:10.681591 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 20:48:10.681591 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 20:48:10.681591 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 20:48:10.682665 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 05 20:48:10.682665 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 05 20:48:10.682665 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 05 20:48:10.682665 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 05 20:48:10.682665 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 05 20:48:10.682665 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 05 20:48:10.682665 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 05 20:48:10.682665 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi Jul 05 20:48:10.682665 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 20:48:10.682665 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi Jul 05 20:48:10.682665 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 20:48:10.682665 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 20:48:10.682665 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 20:48:10.682665 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 05 20:48:10.682665 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 05 20:48:10.682665 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 05 20:48:10.682665 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi Jul 05 20:48:10.682665 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi [None req-6d5aa57e-9178-4a6b-9bd1-103296ee0bb4 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103147) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 05 20:48:10.683676 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: INFO nova.api.openstack.requestlog [None req-6d5aa57e-9178-4a6b-9bd1-103296ee0bb4 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012377 Jul 05 20:48:10.683676 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: [pid: 103147|app: 0|req: 27/52] 10.222.0.20 () {60 vars in 1193 bytes} [Tue Jul 5 20:48:10 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 05 20:48:11.502151 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi [None req-39b6ce63-d4be-469c-84d5-9d99ff2d4954 admin admin] Calling method '>' {{(pid=103148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:48:11.503175 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: INFO nova.api.openstack.requestlog [None req-39b6ce63-d4be-469c-84d5-9d99ff2d4954 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001444 Jul 05 20:48:11.503687 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: [pid: 103148|app: 0|req: 26/53] 10.222.0.20 () {56 vars in 1074 bytes} [Tue Jul 5 20:48:11 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 20:48:11.691782 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi [None req-d2eca8de-423a-4616-932d-621747f53eae admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 20:48:11.710621 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: INFO nova.api.openstack.requestlog [None req-d2eca8de-423a-4616-932d-621747f53eae admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.069900 Jul 05 20:48:11.711216 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: [pid: 103147|app: 0|req: 28/54] 10.222.0.20 () {64 vars in 1235 bytes} [Tue Jul 5 20:48:11 2022] POST /compute/v2.1/flavors => generated 404 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 05 20:48:12.526598 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi [None req-39b6ce63-d4be-469c-84d5-9d99ff2d4954 admin admin] Calling method '>' {{(pid=103148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:48:12.527590 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: INFO nova.api.openstack.requestlog [None req-39b6ce63-d4be-469c-84d5-9d99ff2d4954 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001401 Jul 05 20:48:12.527974 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: [pid: 103148|app: 0|req: 27/55] 10.222.0.20 () {56 vars in 1074 bytes} [Tue Jul 5 20:48:12 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 20:48:12.715729 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi [None req-e3a15147-be30-4112-9c74-dbf3caf1b10c admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 20:48:12.733151 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: INFO nova.api.openstack.requestlog [None req-e3a15147-be30-4112-9c74-dbf3caf1b10c admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.069390 Jul 05 20:48:12.733687 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: [pid: 103147|app: 0|req: 29/56] 10.222.0.20 () {64 vars in 1235 bytes} [Tue Jul 5 20:48:12 2022] POST /compute/v2.1/flavors => generated 405 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 05 20:48:13.562283 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi [None req-39b6ce63-d4be-469c-84d5-9d99ff2d4954 admin admin] Calling method '>' {{(pid=103148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:48:13.563267 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: INFO nova.api.openstack.requestlog [None req-39b6ce63-d4be-469c-84d5-9d99ff2d4954 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001387 Jul 05 20:48:13.563708 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: [pid: 103148|app: 0|req: 28/57] 10.222.0.20 () {56 vars in 1074 bytes} [Tue Jul 5 20:48:13 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 20:48:13.755968 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi [None req-c4016154-8293-4c4e-8a79-eca6afd8416c admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 20:48:13.774690 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: INFO nova.api.openstack.requestlog [None req-c4016154-8293-4c4e-8a79-eca6afd8416c admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.071963 Jul 05 20:48:13.775183 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: [pid: 103147|app: 0|req: 30/58] 10.222.0.20 () {64 vars in 1235 bytes} [Tue Jul 5 20:48:13 2022] POST /compute/v2.1/flavors => generated 407 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 05 20:48:14.593286 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi [None req-39b6ce63-d4be-469c-84d5-9d99ff2d4954 admin admin] Calling method '>' {{(pid=103148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:48:14.594294 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: INFO nova.api.openstack.requestlog [None req-39b6ce63-d4be-469c-84d5-9d99ff2d4954 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001459 Jul 05 20:48:14.594733 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: [pid: 103148|app: 0|req: 29/59] 10.222.0.20 () {56 vars in 1074 bytes} [Tue Jul 5 20:48:14 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 20:48:14.790854 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi [None req-a59ca512-ccef-4b93-a0f8-9cb694cfd729 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 20:48:14.808050 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: INFO nova.api.openstack.requestlog [None req-a59ca512-ccef-4b93-a0f8-9cb694cfd729 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.070174 Jul 05 20:48:14.808579 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: [pid: 103147|app: 0|req: 31/60] 10.222.0.20 () {64 vars in 1235 bytes} [Tue Jul 5 20:48:14 2022] POST /compute/v2.1/flavors => generated 409 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 05 20:48:15.650753 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi [None req-39b6ce63-d4be-469c-84d5-9d99ff2d4954 admin admin] Calling method '>' {{(pid=103148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:48:15.651752 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: INFO nova.api.openstack.requestlog [None req-39b6ce63-d4be-469c-84d5-9d99ff2d4954 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001453 Jul 05 20:48:15.652148 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: [pid: 103148|app: 0|req: 30/61] 10.222.0.20 () {56 vars in 1074 bytes} [Tue Jul 5 20:48:15 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 20:48:15.846801 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi [None req-c5670ef2-1fe3-4d47-843c-9c1be1b2c2bc admin admin] Calling method '>' {{(pid=103147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:48:15.866383 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: INFO nova.api.openstack.requestlog [None req-c5670ef2-1fe3-4d47-843c-9c1be1b2c2bc admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.071379 Jul 05 20:48:15.866853 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: [pid: 103147|app: 0|req: 32/62] 10.222.0.20 () {60 vars in 1202 bytes} [Tue Jul 5 20:48:15 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 20:49:02.711515 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi [None req-39b6ce63-d4be-469c-84d5-9d99ff2d4954 admin admin] Calling method '>' {{(pid=103148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:49:02.712512 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: INFO nova.api.openstack.requestlog [None req-39b6ce63-d4be-469c-84d5-9d99ff2d4954 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001409 Jul 05 20:49:02.712901 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: [pid: 103148|app: 0|req: 31/63] 10.222.0.20 () {54 vars in 930 bytes} [Tue Jul 5 20:49:02 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 20:49:02.724273 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG dbcounter [-] [103147] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=103147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:49:02.776165 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi [None req-e6a8a07b-e9a0-44a1-b5e6-3023325d19af admin admin] Calling method '>' {{(pid=103147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:49:02.796389 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: INFO nova.api.openstack.requestlog [None req-e6a8a07b-e9a0-44a1-b5e6-3023325d19af admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.077647 Jul 05 20:49:02.796946 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: [pid: 103147|app: 0|req: 33/64] 10.222.0.20 () {60 vars in 1291 bytes} [Tue Jul 5 20:49:02 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 20:49:02.819992 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi [None req-dc5e4570-b08a-4b96-8c74-1896d3ab8f47 admin admin] Calling method '>' {{(pid=103148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:49:02.823381 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG dbcounter [-] [103148] Writing DB stats nova_api:SELECT=14 {{(pid=103148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:49:02.828997 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: INFO nova.api.openstack.requestlog [None req-dc5e4570-b08a-4b96-8c74-1896d3ab8f47 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012599 Jul 05 20:49:02.829511 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: [pid: 103148|app: 0|req: 32/65] 10.222.0.20 () {60 vars in 1282 bytes} [Tue Jul 5 20:49:02 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 20:49:02.841432 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi [None req-cde01b85-2ccf-480d-a49e-83dff2cd7edf admin admin] Calling method '>' {{(pid=103147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:49:02.849005 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: INFO nova.api.openstack.requestlog [None req-cde01b85-2ccf-480d-a49e-83dff2cd7edf admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011073 Jul 05 20:49:02.849505 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: [pid: 103147|app: 0|req: 34/66] 10.222.0.20 () {60 vars in 1285 bytes} [Tue Jul 5 20:49:02 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 20:49:02.861081 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi [None req-94efdab0-4a4a-466d-b193-8be32b2d58bb admin admin] Calling method '>' {{(pid=103148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:49:02.868732 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: INFO nova.api.openstack.requestlog [None req-94efdab0-4a4a-466d-b193-8be32b2d58bb admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011164 Jul 05 20:49:02.869582 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: [pid: 103148|app: 0|req: 33/67] 10.222.0.20 () {60 vars in 1285 bytes} [Tue Jul 5 20:49:02 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 20:49:02.881763 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi [None req-9754bfa1-eaed-47eb-aeb2-2f87ad6703c6 admin admin] Calling method '>' {{(pid=103147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:49:02.889327 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: INFO nova.api.openstack.requestlog [None req-9754bfa1-eaed-47eb-aeb2-2f87ad6703c6 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011800 Jul 05 20:49:02.889945 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: [pid: 103147|app: 0|req: 35/68] 10.222.0.20 () {60 vars in 1282 bytes} [Tue Jul 5 20:49:02 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 20:52:17.476743 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi [None req-94efdab0-4a4a-466d-b193-8be32b2d58bb admin admin] Calling method '>' {{(pid=103148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:52:17.477788 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: INFO nova.api.openstack.requestlog [None req-94efdab0-4a4a-466d-b193-8be32b2d58bb admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001467 Jul 05 20:52:17.478182 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: [pid: 103148|app: 0|req: 34/69] 10.222.0.20 () {56 vars in 1074 bytes} [Tue Jul 5 20:52:17 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 20:52:17.620331 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG dbcounter [-] [103147] Writing DB stats nova_api:SELECT=6 {{(pid=103147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:52:17.733336 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi [None req-0b0eb123-880d-4c8a-9fb0-f51196ce9787 admin admin] Calling method '>' {{(pid=103147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:52:17.734495 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 05 20:52:17.734495 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: warnings.warn(msg) Jul 05 20:52:17.735678 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG oslo_concurrency.lockutils [None req-0b0eb123-880d-4c8a-9fb0-f51196ce9787 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103147) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:52:17.736168 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG oslo_concurrency.lockutils [None req-0b0eb123-880d-4c8a-9fb0-f51196ce9787 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103147) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:52:17.736966 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG oslo_concurrency.lockutils [None req-0b0eb123-880d-4c8a-9fb0-f51196ce9787 admin admin] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103147) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:52:17.737399 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG oslo_concurrency.lockutils [None req-0b0eb123-880d-4c8a-9fb0-f51196ce9787 admin admin] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103147) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:52:17.772044 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: INFO nova.api.openstack.requestlog [None req-0b0eb123-880d-4c8a-9fb0-f51196ce9787 admin admin] 10.222.0.20 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.153089 Jul 05 20:52:17.772611 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: [pid: 103147|app: 0|req: 36/70] 10.222.0.20 () {60 vars in 1193 bytes} [Tue Jul 5 20:52:17 2022] GET /compute/v2.1/os-services => generated 794 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 05 20:52:18.602590 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi [None req-94efdab0-4a4a-466d-b193-8be32b2d58bb admin admin] Calling method '>' {{(pid=103148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:52:18.603591 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: INFO nova.api.openstack.requestlog [None req-94efdab0-4a4a-466d-b193-8be32b2d58bb admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001405 Jul 05 20:52:18.603976 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: [pid: 103148|app: 0|req: 35/71] 10.222.0.20 () {56 vars in 1074 bytes} [Tue Jul 5 20:52:18 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 20:52:18.795849 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi [None req-6b4f91d1-ec49-4c1a-9d0c-4dac9390287c admin admin] Calling method '>' {{(pid=103147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:52:18.797044 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 05 20:52:18.797044 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: warnings.warn(msg) Jul 05 20:52:18.798225 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG oslo_concurrency.lockutils [None req-6b4f91d1-ec49-4c1a-9d0c-4dac9390287c admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103147) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:52:18.798661 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG oslo_concurrency.lockutils [None req-6b4f91d1-ec49-4c1a-9d0c-4dac9390287c admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103147) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:52:18.799472 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG oslo_concurrency.lockutils [None req-6b4f91d1-ec49-4c1a-9d0c-4dac9390287c admin admin] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103147) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:52:18.799900 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG oslo_concurrency.lockutils [None req-6b4f91d1-ec49-4c1a-9d0c-4dac9390287c admin admin] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103147) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:52:18.819680 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: INFO nova.api.openstack.requestlog [None req-6b4f91d1-ec49-4c1a-9d0c-4dac9390287c admin admin] 10.222.0.20 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.076707 Jul 05 20:52:18.820154 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: [pid: 103147|app: 0|req: 37/72] 10.222.0.20 () {60 vars in 1193 bytes} [Tue Jul 5 20:52:18 2022] GET /compute/v2.1/os-services => generated 794 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 05 20:52:30.074670 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi [None req-94efdab0-4a4a-466d-b193-8be32b2d58bb admin admin] Calling method '>' {{(pid=103148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:52:30.075665 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: INFO nova.api.openstack.requestlog [None req-94efdab0-4a4a-466d-b193-8be32b2d58bb admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001402 Jul 05 20:52:30.076051 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: [pid: 103148|app: 0|req: 36/73] 10.222.0.20 () {56 vars in 1074 bytes} [Tue Jul 5 20:52:30 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 20:52:30.218140 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG dbcounter [-] [103147] Writing DB stats nova_cell0:SELECT=4 {{(pid=103147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:52:30.218854 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG dbcounter [-] [103147] Writing DB stats nova_cell1:SELECT=4 {{(pid=103147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:52:30.219509 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG dbcounter [-] [103147] Writing DB stats nova_api:SELECT=8 {{(pid=103147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:52:30.266737 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi [None req-c91aa0d5-a267-4a15-86be-eb86c8d3e7cc admin admin] Calling method '>' {{(pid=103147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:52:30.267890 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 05 20:52:30.267890 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: warnings.warn(msg) Jul 05 20:52:30.269085 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG oslo_concurrency.lockutils [None req-c91aa0d5-a267-4a15-86be-eb86c8d3e7cc admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103147) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:52:30.269521 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG oslo_concurrency.lockutils [None req-c91aa0d5-a267-4a15-86be-eb86c8d3e7cc admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103147) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:52:30.270288 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG oslo_concurrency.lockutils [None req-c91aa0d5-a267-4a15-86be-eb86c8d3e7cc admin admin] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103147) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:52:30.270708 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG oslo_concurrency.lockutils [None req-c91aa0d5-a267-4a15-86be-eb86c8d3e7cc admin admin] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103147) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:52:30.295825 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: INFO nova.api.openstack.requestlog [None req-c91aa0d5-a267-4a15-86be-eb86c8d3e7cc admin admin] 10.222.0.20 "GET /compute/v2.1/os-services" status: 200 len: 1014 microversion: 2.90 time: 0.082172 Jul 05 20:52:30.296358 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: [pid: 103147|app: 0|req: 38/74] 10.222.0.20 () {60 vars in 1193 bytes} [Tue Jul 5 20:52:30 2022] GET /compute/v2.1/os-services => generated 1014 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 20:52:31.123937 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi [None req-94efdab0-4a4a-466d-b193-8be32b2d58bb admin admin] Calling method '>' {{(pid=103148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:52:31.124954 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: INFO nova.api.openstack.requestlog [None req-94efdab0-4a4a-466d-b193-8be32b2d58bb admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001432 Jul 05 20:52:31.125343 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: [pid: 103148|app: 0|req: 37/75] 10.222.0.20 () {56 vars in 1074 bytes} [Tue Jul 5 20:52:31 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 20:52:31.314205 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi [None req-1358fc98-3f01-4db6-9e88-762b0527ab49 admin admin] Calling method '>' {{(pid=103147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:52:31.315354 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 05 20:52:31.315354 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: warnings.warn(msg) Jul 05 20:52:31.316551 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG oslo_concurrency.lockutils [None req-1358fc98-3f01-4db6-9e88-762b0527ab49 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103147) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:52:31.317016 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG oslo_concurrency.lockutils [None req-1358fc98-3f01-4db6-9e88-762b0527ab49 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103147) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:52:31.317801 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG oslo_concurrency.lockutils [None req-1358fc98-3f01-4db6-9e88-762b0527ab49 admin admin] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103147) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:52:31.318219 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: DEBUG oslo_concurrency.lockutils [None req-1358fc98-3f01-4db6-9e88-762b0527ab49 admin admin] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103147) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:52:31.340494 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: INFO nova.api.openstack.requestlog [None req-1358fc98-3f01-4db6-9e88-762b0527ab49 admin admin] 10.222.0.20 "GET /compute/v2.1/os-services" status: 200 len: 1014 microversion: 2.90 time: 0.077751 Jul 05 20:52:31.341030 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: [pid: 103147|app: 0|req: 39/76] 10.222.0.20 () {60 vars in 1193 bytes} [Tue Jul 5 20:52:31 2022] GET /compute/v2.1/os-services => generated 1014 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 20:53:27.358997 dv-cinder-797608-49-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jul 05 20:53:27.359552 dv-cinder-797608-49-iscsi devstack@n-api.service[103146]: Tue Jul 5 20:53:27 2022 - graceful shutdown triggered... Jul 05 20:53:27.360017 dv-cinder-797608-49-iscsi devstack@n-api.service[103148]: Gracefully killing worker 2 (pid: 103148)... Jul 05 20:53:27.360395 dv-cinder-797608-49-iscsi devstack@n-api.service[103147]: Gracefully killing worker 1 (pid: 103147)... Jul 05 20:53:28.360703 dv-cinder-797608-49-iscsi devstack@n-api.service[103146]: worker 1 buried after 1 seconds Jul 05 20:53:28.361310 dv-cinder-797608-49-iscsi devstack@n-api.service[103146]: worker 2 buried after 1 seconds Jul 05 20:53:28.361310 dv-cinder-797608-49-iscsi devstack@n-api.service[103146]: goodbye to uWSGI. Jul 05 20:53:28.362315 dv-cinder-797608-49-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jul 05 20:53:28.362890 dv-cinder-797608-49-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jul 05 20:53:28.365757 dv-cinder-797608-49-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jul 05 20:53:28.375064 dv-cinder-797608-49-iscsi devstack@n-api.service[117606]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 05 20:53:28.377059 dv-cinder-797608-49-iscsi devstack@n-api.service[117606]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Jul 5 20:53:28 2022] *** Jul 05 20:53:28.377059 dv-cinder-797608-49-iscsi devstack@n-api.service[117606]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 05 20:53:28.377059 dv-cinder-797608-49-iscsi devstack@n-api.service[117606]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 05 20:53:28.377059 dv-cinder-797608-49-iscsi devstack@n-api.service[117606]: nodename: dv-cinder-797608-49-iscsi Jul 05 20:53:28.377059 dv-cinder-797608-49-iscsi devstack@n-api.service[117606]: machine: x86_64 Jul 05 20:53:28.377059 dv-cinder-797608-49-iscsi devstack@n-api.service[117606]: clock source: unix Jul 05 20:53:28.377059 dv-cinder-797608-49-iscsi devstack@n-api.service[117606]: pcre jit disabled Jul 05 20:53:28.377059 dv-cinder-797608-49-iscsi devstack@n-api.service[117606]: detected number of CPU cores: 4 Jul 05 20:53:28.377059 dv-cinder-797608-49-iscsi devstack@n-api.service[117606]: current working directory: / Jul 05 20:53:28.377059 dv-cinder-797608-49-iscsi devstack@n-api.service[117606]: detected binary path: /usr/bin/uwsgi-core Jul 05 20:53:28.377870 dv-cinder-797608-49-iscsi devstack@n-api.service[117606]: your processes number limit is 47680 Jul 05 20:53:28.377870 dv-cinder-797608-49-iscsi devstack@n-api.service[117606]: your memory page size is 4096 bytes Jul 05 20:53:28.377870 dv-cinder-797608-49-iscsi devstack@n-api.service[117606]: detected max file descriptor number: 2048 Jul 05 20:53:28.377870 dv-cinder-797608-49-iscsi devstack@n-api.service[117606]: lock engine: pthread robust mutexes Jul 05 20:53:28.377870 dv-cinder-797608-49-iscsi devstack@n-api.service[117606]: thunder lock: enabled Jul 05 20:53:28.377870 dv-cinder-797608-49-iscsi devstack@n-api.service[117606]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 05 20:53:28.377870 dv-cinder-797608-49-iscsi devstack@n-api.service[117606]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jul 05 20:53:28.423631 dv-cinder-797608-49-iscsi devstack@n-api.service[117606]: Python main interpreter initialized at 0x55c6a02c49c0 Jul 05 20:53:28.423631 dv-cinder-797608-49-iscsi devstack@n-api.service[117606]: python threads support enabled Jul 05 20:53:28.423631 dv-cinder-797608-49-iscsi devstack@n-api.service[117606]: your server socket listen backlog is limited to 100 connections Jul 05 20:53:28.423631 dv-cinder-797608-49-iscsi devstack@n-api.service[117606]: your mercy for graceful operations on workers is 90 seconds Jul 05 20:53:28.425381 dv-cinder-797608-49-iscsi devstack@n-api.service[117606]: mapped 403077 bytes (393 KB) for 2 cores Jul 05 20:53:28.425496 dv-cinder-797608-49-iscsi devstack@n-api.service[117606]: *** Operational MODE: preforking *** Jul 05 20:53:28.425811 dv-cinder-797608-49-iscsi devstack@n-api.service[117606]: *** uWSGI is running in multiple interpreter mode *** Jul 05 20:53:28.425970 dv-cinder-797608-49-iscsi devstack@n-api.service[117606]: spawned uWSGI master process (pid: 117606) Jul 05 20:53:28.426307 dv-cinder-797608-49-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jul 05 20:53:28.426884 dv-cinder-797608-49-iscsi devstack@n-api.service[117606]: spawned uWSGI worker 1 (pid: 117627, cores: 1) Jul 05 20:53:28.427426 dv-cinder-797608-49-iscsi devstack@n-api.service[117606]: spawned uWSGI worker 2 (pid: 117628, cores: 1) Jul 05 20:53:28.427725 dv-cinder-797608-49-iscsi devstack@n-api.service[117606]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 05 20:53:29.100421 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 05 20:53:29.101361 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 05 20:53:30.290960 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 05 20:53:30.290960 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: from cryptography.utils import int_from_bytes Jul 05 20:53:30.291747 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 05 20:53:30.291747 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: from cryptography.utils import int_from_bytes Jul 05 20:53:30.321614 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 05 20:53:30.321614 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: from cryptography.utils import int_from_bytes Jul 05 20:53:30.322230 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 05 20:53:30.322230 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: from cryptography.utils import int_from_bytes Jul 05 20:53:32.573485 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 05 20:53:32.574042 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 05 20:53:32.574321 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 05 20:53:32.574605 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 05 20:53:32.574857 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 05 20:53:32.575241 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:53:32.575559 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:53:32.575880 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:53:32.576196 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:53:32.576520 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:53:32.576827 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:53:32.577166 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:53:32.577489 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:53:32.577813 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:53:32.578072 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:53:32.578380 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:53:32.578696 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-797608-49-iscsi {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:53:32.579013 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:53:32.579316 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:53:32.579626 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:53:32.579938 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:53:32.580237 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:53:32.580549 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:53:32.581057 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:53:32.581554 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:53:32.582004 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:53:32.582313 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:53:32.582621 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:53:32.583012 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:53:32.583263 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:53:32.583781 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:53:32.583908 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:53:32.584163 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:53:32.584481 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:53:32.584834 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:53:32.585330 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-797608-49-iscsi {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:53:32.585671 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:53:32.585995 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:53:32.586295 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:53:32.586706 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:53:32.587027 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:53:32.587337 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:53:32.587663 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:53:32.587976 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:53:32.588284 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:53:32.588606 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:53:32.588997 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:53:32.589256 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:53:32.589570 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:53:32.589870 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:53:32.590171 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:53:32.590641 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:53:32.590967 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:53:32.591269 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:53:32.591574 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:53:32.591825 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:53:32.592136 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:53:32.592456 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:53:32.592777 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:53:32.593129 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:53:32.593378 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:53:32.593628 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:53:32.593944 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:53:32.594262 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:53:32.594568 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:53:32.594877 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:53:32.595183 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:53:32.595489 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:53:32.595793 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:53:32.596098 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:53:32.596401 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:53:32.596704 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:53:32.597056 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:53:32.597378 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:53:32.597696 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:53:32.598020 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:53:32.598319 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:53:32.598710 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.20 {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:53:32.598958 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.20 {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:53:32.599266 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:53:32.599598 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:53:32.599912 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:53:32.600218 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:53:32.601110 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:53:32.601430 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:53:32.601730 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:53:32.602032 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:53:32.602338 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:53:32.602653 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:53:32.602983 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:53:32.603286 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:53:32.603536 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:53:32.603837 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:53:32.604140 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:53:32.604455 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:53:32.604757 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:53:32.605082 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:53:32.605390 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:53:32.605687 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:53:32.605988 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:53:32.606291 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:53:32.606593 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:53:32.606892 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:53:32.607195 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:53:32.607500 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:53:32.607804 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:53:32.608103 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:53:32.608402 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:53:32.608715 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:53:32.609061 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:53:32.609367 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:53:32.609669 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:53:32.609970 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:53:32.610270 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:53:32.610585 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:53:32.610887 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:53:32.611257 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:53:32.611490 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:53:32.611791 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:53:32.612090 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:53:32.612401 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:53:32.612706 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:53:32.613039 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:53:32.613358 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:53:32.613656 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:53:32.613961 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:53:32.614273 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:53:32.614576 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:53:32.614876 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:53:32.615178 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:53:32.615478 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:53:32.615946 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:53:32.616789 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:53:32.617125 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:53:32.617427 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:53:32.617729 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:53:32.618045 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:53:32.618374 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:53:32.618668 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:53:32.618974 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:53:32.619276 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:53:32.619586 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:53:32.619713 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 05 20:53:32.620115 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 05 20:53:32.620500 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 05 20:53:32.620628 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.620865 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 05 20:53:32.621020 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.621266 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 05 20:53:32.621381 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.621617 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.621726 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:53:32.621909 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.622004 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:53:32.622245 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.622332 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:53:32.622548 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.622665 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:53:32.622864 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.622967 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:53:32.623184 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.623299 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:53:32.623514 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:53:32.623632 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.623881 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.623979 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:53:32.624125 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.624233 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:53:32.624411 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:53:32.624507 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.624710 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:53:32.624812 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.625049 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.625162 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-797608-49-iscsi {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:53:32.625370 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:53:32.625475 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.625678 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:53:32.625785 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.625988 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.626091 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:53:32.626301 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:53:32.626403 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.626605 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:53:32.626700 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.626921 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.627023 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:53:32.627224 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:53:32.627325 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.627559 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.627723 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:53:32.627870 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.628034 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:53:32.628208 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.628342 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:53:32.628550 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.628653 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:53:32.628862 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.628989 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:53:32.629213 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.629354 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:53:32.629537 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.629644 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:53:32.629847 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.629951 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:53:32.630155 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.630258 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:53:32.630460 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.630564 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:53:32.630781 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.630875 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:53:32.631117 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.631228 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-797608-49-iscsi {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:53:32.631428 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.631533 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:53:32.631767 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.631907 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:53:32.632081 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.632235 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:53:32.632478 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.632654 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:53:32.632807 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.632989 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:53:32.633123 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.633305 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:53:32.633436 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.633628 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:53:32.633769 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.633966 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:53:32.634064 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.634277 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:53:32.634374 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.634606 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:53:32.634700 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.634929 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:53:32.635025 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.635251 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:53:32.635347 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.635563 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.635864 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:53:32.636004 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.636172 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.636291 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:53:32.636474 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.636568 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:53:32.636781 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.636915 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:53:32.637136 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.637250 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:53:32.637459 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.637571 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:53:32.637779 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.637881 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:53:32.638066 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:53:32.638190 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.638381 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:53:32.638484 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.638706 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:53:32.638809 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.639008 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.639176 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:53:32.639365 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.639490 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:53:32.639704 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.639807 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:53:32.639929 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:53:32.641326 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.641326 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.641641 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:53:32.641803 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.641965 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:53:32.642267 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.642428 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:53:32.642577 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.642725 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:53:32.642872 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.643053 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:53:32.643213 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.643795 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:53:32.643964 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.644122 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:53:32.644289 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.645189 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:53:32.645314 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.645398 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:53:32.645491 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.645580 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:53:32.645667 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.645743 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:53:32.645816 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.645897 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:53:32.645971 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.646052 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:53:32.646319 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.646419 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:53:32.646504 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.646504 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.646650 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:53:32.646733 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.646822 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.20 {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:53:32.646903 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.646977 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.20 {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:53:32.647048 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.647119 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:53:32.647369 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.647470 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:53:32.647554 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.647629 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:53:32.647718 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.647805 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:53:32.647888 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.647963 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:53:32.648042 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.648122 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:53:32.648549 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.648645 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:53:32.648740 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.648834 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:53:32.648918 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.649027 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:53:32.649180 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.649374 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:53:32.649541 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.649663 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:53:32.649663 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:53:32.649814 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.649895 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:53:32.649976 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.650050 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:53:32.650222 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:53:32.650444 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.650695 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:53:32.650772 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.650844 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:53:32.650916 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.651108 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:53:32.651271 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.651458 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:53:32.651657 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.651931 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:53:32.652108 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.652546 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:53:32.652728 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.652979 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:53:32.653128 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.653539 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:53:32.653966 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.654125 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:53:32.654282 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.654683 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:53:32.654893 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.655052 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:53:32.655211 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.655728 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:53:32.655920 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.656083 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:53:32.656083 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:53:32.656731 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.657021 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:53:32.657192 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.657342 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:53:32.657497 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.657645 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:53:32.657851 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.658069 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:53:32.658882 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.659662 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:53:32.659861 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.660028 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:53:32.660226 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.660375 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:53:32.660559 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.660717 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:53:32.660901 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.661084 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:53:32.661232 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.661390 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:53:32.662173 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.662362 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:53:32.662516 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.662665 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:53:32.662824 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.664303 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:53:32.664475 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.664627 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:53:32.664783 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.666389 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:53:32.666589 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.666755 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:53:32.666919 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.667094 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:53:32.667246 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.667394 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:53:32.667584 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.667758 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:53:32.667910 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.668069 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:53:32.668069 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:53:32.668400 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.668547 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:53:32.668704 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.668860 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:53:32.669077 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.669240 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:53:32.669389 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.669544 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:53:32.669703 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.670458 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:53:32.670804 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.670964 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:53:32.671127 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.671285 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:53:32.671443 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.671443 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.672354 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:53:32.672698 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.672859 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:53:32.673045 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.673205 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:53:32.673362 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.673519 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:53:32.673687 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.673837 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:53:32.674316 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.674700 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:53:32.674883 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.675057 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.675215 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.675363 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.676016 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.676184 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.676378 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.676552 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.676712 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.676861 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.677049 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.677217 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.677394 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.677546 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.677699 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.677860 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.678016 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.678171 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.678333 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.678588 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.679341 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.679559 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.679801 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.680041 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.680206 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.680355 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.680536 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.680697 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.680846 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.681046 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.681210 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.681366 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.681521 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.681677 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.681840 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.682109 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.682274 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.682429 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.682577 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.682756 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.682915 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.683075 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.683223 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.683377 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.683532 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.683532 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.683845 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.684013 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.684314 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.684482 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.684639 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.684788 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.684970 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.685128 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.685277 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.685435 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.685590 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.686154 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.686393 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.686553 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.686711 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.686860 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.687016 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.687165 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.687322 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.687470 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.687617 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.687783 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.687945 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.688101 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.688264 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.688420 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.688603 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.688768 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.688995 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.689169 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.689328 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.689485 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.689641 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.689789 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.689937 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.690093 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.690241 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.690397 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.690551 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.690699 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.690889 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.691066 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.691224 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.691381 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.691529 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.691676 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.691857 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.692025 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.692276 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.692431 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.692587 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.692743 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.692891 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.693077 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.693248 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.693405 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.693554 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.693709 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.693865 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.694012 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.694198 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.694518 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.694693 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.694842 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.695000 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.695000 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.695288 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.695456 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.695617 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.695765 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.696322 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.696488 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.696672 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.696826 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.696992 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.697161 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.697311 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.697465 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.697613 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.697789 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.697986 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.698143 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.698291 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.698447 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.698608 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.698766 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.698956 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.699121 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.699277 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.699425 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.699579 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.699775 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.699987 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.700146 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.700301 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.700463 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.700627 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.700782 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.700992 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.701164 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.701326 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.701480 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.701643 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.701806 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.701969 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.702134 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.702314 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.702570 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.702743 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.702899 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.703061 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.703216 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.703377 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.703531 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.703694 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.703849 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.704011 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.704177 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.704330 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.704517 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.704806 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.704990 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.705163 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.705318 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.705491 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.705491 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.705801 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.705801 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.706630 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.706805 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.707008 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.707180 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.707343 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.707507 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.707662 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.707835 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.708038 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.708215 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.708378 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.708378 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.708689 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.708689 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.709027 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.709202 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.709357 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.709520 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.710300 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.710594 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.710769 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.710932 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.711086 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.711248 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.711446 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.711616 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.711781 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.711936 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.712107 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.712270 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.712466 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.712621 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.713042 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.713237 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.713606 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.713606 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.713877 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.714061 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.714292 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.714417 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.714541 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.714700 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.714969 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.715247 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.715247 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.715554 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.715554 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.715864 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.716018 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.716679 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.716856 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.717095 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.717341 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.717515 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.717680 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.717851 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.718012 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.718166 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.718441 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.718618 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.718618 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.719007 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.719169 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.719323 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.719566 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.719722 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.719898 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.720063 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.720218 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.720449 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.720610 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.720774 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.721023 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.721197 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.721353 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.721508 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.721668 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.721834 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.721989 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.722162 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.722318 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.722544 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.722703 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.722874 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.723038 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.723200 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.723363 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.723518 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.723800 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.723978 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.724141 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.724298 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.724464 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.724669 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.724833 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.725029 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.725277 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.725973 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.726234 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.726871 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.727046 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.727046 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.727352 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.727507 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.727674 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.727830 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.727994 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.728152 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.728325 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.729113 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.729280 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.729448 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.729614 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.729614 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.729920 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.730077 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.730233 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.730400 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.730569 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.730726 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.730924 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.731095 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.731260 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.731432 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.731597 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.731754 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.731916 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.732071 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.732225 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.732390 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.732558 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.732714 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.732868 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.733096 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.733264 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.733436 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.733591 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.733746 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.734017 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.734186 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.734344 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.734509 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.734509 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.734816 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.735021 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.735190 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.735363 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.735535 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.735700 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.735864 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.736028 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.736300 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.736479 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.737112 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.737326 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.737485 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.737668 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.737832 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.737999 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.738163 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.738326 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.738502 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.738669 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.738824 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.739028 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.739199 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.739354 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.739515 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.739683 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.739845 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.740026 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.740194 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.740349 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.740502 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.740656 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.740820 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.741070 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.741814 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.741984 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.742149 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.742312 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.742490 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.742646 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.742801 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.742967 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.743170 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.743331 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.743496 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.743659 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.743816 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.743971 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.744246 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.744407 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.744571 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.744743 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.744908 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.745090 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.745258 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.745428 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.745591 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.745754 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.745910 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.746065 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.746229 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.746512 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.746676 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.747269 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.747455 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.747612 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.747774 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.747941 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.748099 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.748262 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.748424 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.748593 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.748756 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.749005 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.749172 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.749328 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.749495 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.749495 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.749840 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.750002 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.750157 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.750311 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.750465 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.750619 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.750789 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.750944 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.751098 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.751304 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.751464 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.751637 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.751807 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.751964 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.752118 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.752273 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.752427 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.752580 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.752747 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.752911 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.753092 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.753260 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.753417 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.754186 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.754486 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.754776 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.754964 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.755133 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.755298 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.755463 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.755628 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.755798 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.755954 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.756193 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.756351 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.756533 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.756819 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.757417 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.757602 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.757759 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.757948 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.757948 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.758256 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.758419 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.758593 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.758749 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.758905 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.759060 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.759221 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.759429 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.759600 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.759755 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.759909 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.760071 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.760574 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.760734 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.760906 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.764525 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.764827 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.765032 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.765209 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.765381 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.765565 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.765722 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.765879 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.765879 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.766225 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.766564 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.766729 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.767037 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.767779 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.767956 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.768123 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.768280 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.768457 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.768622 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.768778 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.768778 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.769228 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.769387 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.769542 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.769706 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.769869 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.770041 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.770206 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.770362 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.770525 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.770700 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.771398 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.771578 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.771743 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.771899 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.772053 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.772216 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.772416 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.772630 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.772793 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.772988 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.773543 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.773730 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.773887 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.774089 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.774261 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.774424 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.774579 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.774740 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.774909 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.775289 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.775575 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.780009 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.780186 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.780350 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.780536 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.780696 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.780853 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.781073 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.781235 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.781408 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.781582 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.781738 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.781893 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.782048 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.782202 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.782364 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.782529 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.782706 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.782877 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.783040 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.783204 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.783368 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.783533 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.783689 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.783843 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.784005 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.784168 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.784338 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.784501 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.784656 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.784828 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.785013 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.785185 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.785362 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.785519 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.785786 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.785959 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.786116 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.786278 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.786444 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.786608 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.786764 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.786949 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.787106 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.787276 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.787439 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.787594 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.787757 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.788485 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.788711 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.788897 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.789080 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.789249 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.789434 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.790101 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.790311 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.790482 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.790638 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.790803 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.790968 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.791123 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.791277 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.791442 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.791598 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.791761 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.791917 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.792081 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.792246 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.792422 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.792587 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.792745 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.792890 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.793053 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.793208 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.793357 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.793517 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.793689 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.793844 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.794005 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.794172 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.794328 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.794502 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.794665 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.794827 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.794982 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.795150 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.795314 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.795478 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.795643 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.795835 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.796093 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.796263 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.796419 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.796573 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.796747 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.796913 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.797137 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.797295 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.797524 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.797692 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.797849 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.798019 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.798182 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.798346 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.798502 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.798664 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.798920 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.799091 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.799266 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.799424 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.799578 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.800851 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.801064 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.801227 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.801385 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.801542 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.801696 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.801851 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.802015 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.802192 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.802357 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.802514 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.802514 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.802825 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.802991 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.803156 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.803311 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.803503 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.803748 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.803919 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.804077 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.804230 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.804406 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.804561 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.804716 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.804885 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.805076 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.805240 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.805240 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.805240 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.805240 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.805240 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.805240 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.805240 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.805240 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.806632 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.806632 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.806632 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.806632 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.806632 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.806632 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.807532 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.807698 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.807698 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.807994 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.808148 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.808326 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.808490 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.808659 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.808831 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.809075 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.809258 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.809423 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.809588 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.809751 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.810283 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.810447 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.810610 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.810798 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.811135 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.811294 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.811448 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.811448 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.811744 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.811913 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.811913 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.811913 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.811913 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.811913 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.811913 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.811913 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.811913 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.813983 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.814144 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.814298 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.814452 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.814621 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.814621 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.814924 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.815081 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.815236 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.815398 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.815574 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.815730 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.815905 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.816071 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.816247 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.816495 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.816668 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.816824 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.817020 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.817193 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.817359 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.817522 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.817522 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.817522 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.817522 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.817522 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.817522 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.817522 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.817522 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.818693 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.818855 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.819013 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.819694 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.819861 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.820398 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.820583 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.820740 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.820906 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.821311 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.821311 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.821621 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.821621 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.822007 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.822183 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.822388 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.822551 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.822714 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.822894 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.823054 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.823217 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.823393 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.823550 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.823705 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.823859 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.824021 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.824021 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.824329 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.824492 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.824655 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.824818 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.825004 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.825167 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.825336 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.825511 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.825668 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.825830 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.825830 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.826136 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.826311 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.827003 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.827170 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.827170 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.827479 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.827643 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.827800 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.827967 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.828131 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.828294 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.828458 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.828627 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.828784 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.828965 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.829129 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.829303 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.829473 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.829644 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.829800 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.829955 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.830128 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.830629 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.830808 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.830974 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.830974 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.830974 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.830974 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.831761 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.831932 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.832096 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.832259 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.832415 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.832571 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.832737 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.832902 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.833125 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.833292 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.833448 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.833602 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.833602 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.833991 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.833991 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.834290 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.834444 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.834606 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.835402 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.836127 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.836304 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.836461 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.836461 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.836765 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.836959 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.837224 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.837404 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.837570 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.837734 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.837891 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.838056 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.838235 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.838441 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.838605 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.838761 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.838924 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.839090 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.839255 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.839416 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.839572 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.839727 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.839896 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.840053 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.840209 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.840877 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.841094 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.841252 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.841682 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.841849 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.842011 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.842175 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.842332 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.842496 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.842669 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.842833 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.842833 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.843152 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.843315 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.843483 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.844256 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.844437 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.844611 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.844776 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.844979 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.845156 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.845156 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.845469 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.845652 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.845817 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.845982 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.846139 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.846139 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.846542 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.846702 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.846858 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.847013 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.847203 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.847526 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.847699 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.847864 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.848038 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.848195 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.848360 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.848517 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.848688 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.848847 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.849034 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.849194 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.849375 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.849549 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.849716 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.849881 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.850058 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.850217 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.850450 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.850450 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.851529 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.851955 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.852140 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.853001 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.853190 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.853364 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.853521 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.853677 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.853841 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.859656 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.860015 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.861845 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.862303 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.862492 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.862659 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.862822 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.862994 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.863162 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.863386 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.863541 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.863687 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.863836 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.864007 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.864163 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.864369 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.864369 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.864369 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.864922 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.865270 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.865453 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.865600 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.865811 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.865984 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.866199 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.866356 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.866599 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.866770 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.866928 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.867293 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.867460 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.867605 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.867758 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.867909 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.868053 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.868202 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.868359 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.868502 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.868660 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.868803 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.868989 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.869129 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.869290 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.869440 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.869590 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.869762 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.869762 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.869999 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.870088 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.870184 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.870278 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.870365 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.870504 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.870613 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.870703 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.870788 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.870788 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.870946 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.870946 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.871151 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.871249 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.871731 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.871821 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.871821 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.871997 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.872098 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.872273 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.872373 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.872468 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.872556 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.872656 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.872751 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.872838 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.872923 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.872923 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.873296 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.873393 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.873488 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.873575 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.873668 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.873763 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.873866 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.873968 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.874056 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.874142 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.874228 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.874313 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.874406 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.874584 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.874679 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.874766 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.874864 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.874953 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.875049 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.875145 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.875235 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.875331 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.875418 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.875505 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.875605 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.875693 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.875787 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.875874 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.875967 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.876065 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.876154 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.876248 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.876335 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.876428 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.876523 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.876619 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.876714 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.876808 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.876895 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.877013 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.877106 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.877207 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.877296 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.877382 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.877468 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.878218 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.878378 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.878520 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.878662 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.878794 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.878924 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.879064 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.879228 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.879777 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.879918 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.880049 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.880181 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.880319 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.880464 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.880605 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.880736 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.880866 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.881022 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.881160 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.881293 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.881448 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.882912 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.883106 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.883106 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.883378 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.883510 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.883650 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.883780 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 05 20:53:32.883909 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.883909 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.883909 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.883909 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.883909 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.883909 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.883909 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.883909 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.884985 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.884985 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.884985 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.884985 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.884985 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.884985 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.884985 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.884985 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.885951 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.885951 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.885951 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.885951 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.885951 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.885951 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.885951 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.885951 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.887423 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.887423 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.887423 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.887423 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.887423 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.887423 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.887423 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.887423 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.888324 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.888324 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.888324 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.888324 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.888324 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.888324 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.888324 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.888324 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.889510 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.889510 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.889510 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.889510 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.889510 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.889510 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.889510 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.889510 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.890522 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.890522 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.890522 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.890522 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.890522 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.890522 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.890522 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.890522 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.891523 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.891523 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.891523 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.891523 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.891523 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.891523 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.891523 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.891523 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.892653 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.892653 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.892653 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.892653 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.892653 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.892653 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.892653 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.892653 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.894329 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.894329 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.894329 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.894329 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.894329 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.894329 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.894329 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.894329 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.895276 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.895276 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.895276 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.895276 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.895276 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.895276 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.895276 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.895276 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.896263 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.896263 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.896263 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.896263 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.896263 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.896263 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.896263 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.896263 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.898772 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.898772 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.898772 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.898772 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.898772 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.898772 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.898772 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.898772 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.899693 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.899693 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.899693 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.899693 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.899693 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.899693 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.899693 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.899693 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.900702 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.900702 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.900702 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.900702 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.900702 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.900702 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.900702 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.900702 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.901611 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.901611 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.901611 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.901611 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.901611 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.901611 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.901611 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.901611 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.902308 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.902308 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.902308 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.902308 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.902308 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.902308 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.902308 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.902308 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.903528 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.903528 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.903528 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.903528 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.903528 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.903528 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.903528 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.903528 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.904436 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.904436 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.904436 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.904436 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.904436 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.904436 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.904436 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.905121 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.905399 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.905809 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.906208 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.906605 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.907131 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.907541 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.907876 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.908299 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.908680 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.909112 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.909450 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.909782 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.910129 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.910457 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.910782 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.911114 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.911446 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.911771 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.912102 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.912432 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.912773 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.913217 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.913810 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.914492 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.914844 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.915213 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.915540 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.915899 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.916239 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.916565 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.916911 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.917253 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:53:32.917504 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 05 20:53:32.993441 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO dbcounter [None req-8672e15f-489e-4c6e-9156-33c9721c9920 None None] Registered counter for database nova_api Jul 05 20:53:33.014035 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_db.sqlalchemy.engines [None req-8672e15f-489e-4c6e-9156-33c9721c9920 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117627) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 05 20:53:33.020943 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG dbcounter [-] [117627] Writer thread running {{(pid=117627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 05 20:53:33.070052 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO dbcounter [None req-ad09dc7e-29b2-4142-8155-4c19308d1455 None None] Registered counter for database nova_api Jul 05 20:53:33.077031 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.context [None req-8672e15f-489e-4c6e-9156-33c9721c9920 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),78cfd685-d36c-4d6a-bc57-de3ea03c21ea(cell1) {{(pid=117627) load_cells /opt/stack/nova/nova/context.py:464}} Jul 05 20:53:33.080882 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-8672e15f-489e-4c6e-9156-33c9721c9920 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:53:33.082476 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-8672e15f-489e-4c6e-9156-33c9721c9920 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:53:33.083267 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-8672e15f-489e-4c6e-9156-33c9721c9920 None None] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:53:33.085376 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-8672e15f-489e-4c6e-9156-33c9721c9920 None None] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:53:33.087338 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO dbcounter [None req-8672e15f-489e-4c6e-9156-33c9721c9920 None None] Registered counter for database nova_cell0 Jul 05 20:53:33.089828 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_db.sqlalchemy.engines [None req-ad09dc7e-29b2-4142-8155-4c19308d1455 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117628) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 05 20:53:33.091468 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO dbcounter [None req-8672e15f-489e-4c6e-9156-33c9721c9920 None None] Registered counter for database nova_cell1 Jul 05 20:53:33.096748 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG dbcounter [-] [117628] Writer thread running {{(pid=117628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 05 20:53:33.098605 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_db.sqlalchemy.engines [None req-8672e15f-489e-4c6e-9156-33c9721c9920 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117627) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 05 20:53:33.100794 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_db.sqlalchemy.engines [None req-8672e15f-489e-4c6e-9156-33c9721c9920 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117627) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 05 20:53:33.106266 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG dbcounter [-] [117627] Writer thread running {{(pid=117627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 05 20:53:33.108308 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG dbcounter [-] [117627] Writer thread running {{(pid=117627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 05 20:53:33.154939 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.context [None req-ad09dc7e-29b2-4142-8155-4c19308d1455 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),78cfd685-d36c-4d6a-bc57-de3ea03c21ea(cell1) {{(pid=117628) load_cells /opt/stack/nova/nova/context.py:464}} Jul 05 20:53:33.158893 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-ad09dc7e-29b2-4142-8155-4c19308d1455 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:53:33.160489 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-ad09dc7e-29b2-4142-8155-4c19308d1455 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:53:33.161327 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-ad09dc7e-29b2-4142-8155-4c19308d1455 None None] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:53:33.163429 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-ad09dc7e-29b2-4142-8155-4c19308d1455 None None] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:53:33.165434 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO dbcounter [None req-ad09dc7e-29b2-4142-8155-4c19308d1455 None None] Registered counter for database nova_cell0 Jul 05 20:53:33.169471 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO dbcounter [None req-ad09dc7e-29b2-4142-8155-4c19308d1455 None None] Registered counter for database nova_cell1 Jul 05 20:53:33.176516 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_db.sqlalchemy.engines [None req-ad09dc7e-29b2-4142-8155-4c19308d1455 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117628) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 05 20:53:33.179432 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_db.sqlalchemy.engines [None req-ad09dc7e-29b2-4142-8155-4c19308d1455 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117628) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 05 20:53:33.184553 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG dbcounter [-] [117628] Writer thread running {{(pid=117628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 05 20:53:33.189917 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG dbcounter [-] [117628] Writer thread running {{(pid=117628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 05 20:53:33.251231 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO dbcounter [None req-8672e15f-489e-4c6e-9156-33c9721c9920 None None] Registered counter for database nova_cell0 Jul 05 20:53:33.258783 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_db.sqlalchemy.engines [None req-8672e15f-489e-4c6e-9156-33c9721c9920 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117627) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 05 20:53:33.263158 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG dbcounter [-] [117627] Writer thread running {{(pid=117627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 05 20:53:33.335117 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO dbcounter [None req-ad09dc7e-29b2-4142-8155-4c19308d1455 None None] Registered counter for database nova_cell0 Jul 05 20:53:33.341856 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_db.sqlalchemy.engines [None req-ad09dc7e-29b2-4142-8155-4c19308d1455 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117628) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 05 20:53:33.346670 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG dbcounter [-] [117628] Writer thread running {{(pid=117628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 05 20:53:33.584720 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: WARNING keystonemiddleware.auth_token [None req-8672e15f-489e-4c6e-9156-33c9721c9920 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 05 20:53:33.592202 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: WARNING keystonemiddleware.auth_token [None req-8672e15f-489e-4c6e-9156-33c9721c9920 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 05 20:53:33.682592 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: WARNING keystonemiddleware.auth_token [None req-ad09dc7e-29b2-4142-8155-4c19308d1455 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 05 20:53:33.690006 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: WARNING keystonemiddleware.auth_token [None req-ad09dc7e-29b2-4142-8155-4c19308d1455 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 05 20:53:33.935154 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: WARNING keystonemiddleware.auth_token [None req-8672e15f-489e-4c6e-9156-33c9721c9920 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 05 20:53:33.941363 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: WARNING keystonemiddleware.auth_token [None req-8672e15f-489e-4c6e-9156-33c9721c9920 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 05 20:53:33.947014 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55c6a02c49c0 pid: 117627 (default app) Jul 05 20:53:34.034864 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: WARNING keystonemiddleware.auth_token [None req-ad09dc7e-29b2-4142-8155-4c19308d1455 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 05 20:53:34.041616 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: WARNING keystonemiddleware.auth_token [None req-ad09dc7e-29b2-4142-8155-4c19308d1455 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 05 20:53:34.047021 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55c6a02c49c0 pid: 117628 (default app) Jul 05 20:54:14.678296 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG dbcounter [-] [117627] Writing DB stats nova_api:SELECT=3 {{(pid=117627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:54:14.679216 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG dbcounter [-] [117627] Writing DB stats nova_cell1:SELECT=3 {{(pid=117627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:54:14.680272 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG dbcounter [-] [117627] Writing DB stats nova_cell0:SELECT=3 {{(pid=117627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:54:14.681339 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG dbcounter [-] [117627] Writing DB stats nova_cell0:SELECT=3 {{(pid=117627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:54:15.691417 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-b1cccf42-d758-4879-b670-8393f3da3d6a tempest-VolumesGetTestJSON-2114351129 tempest-VolumesGetTestJSON-2114351129-project] Action: 'create', calling method: .version_select at 0x7f57cffd9550>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-955877243", "metadata": {"Type": "work"}}} {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 20:54:15.828470 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG dbcounter [-] [117628] Writing DB stats nova_api:SELECT=3 {{(pid=117628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:54:15.829955 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG dbcounter [-] [117628] Writing DB stats nova_cell0:SELECT=3 {{(pid=117628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:54:15.830884 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG dbcounter [-] [117628] Writing DB stats nova_cell1:SELECT=3 {{(pid=117628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:54:15.832115 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG dbcounter [-] [117628] Writing DB stats nova_cell0:SELECT=3 {{(pid=117628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:54:16.873837 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-b1bc3bf5-91a2-4014-a760-155c0ce6bd3e tempest-VolumesSnapshotsTestJSON-685376017 tempest-VolumesSnapshotsTestJSON-685376017-project] Action: 'create', calling method: .version_select at 0x7f57cffdd550>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-680222917"}} {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 20:54:17.881340 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-b1cccf42-d758-4879-b670-8393f3da3d6a tempest-VolumesGetTestJSON-2114351129 tempest-VolumesGetTestJSON-2114351129-project] 10.222.0.20 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 3.214490 Jul 05 20:54:17.881995 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 1/1] 10.222.0.20 () {60 vars in 1155 bytes} [Tue Jul 5 20:54:14 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 3217 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Jul 05 20:54:17.894907 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-c37aefe7-bdf3-406a-af2a-c3dfd43855ae tempest-VolumesGetTestJSON-2114351129 tempest-VolumesGetTestJSON-2114351129-project] Calling method '.version_select at 0x7f57cfe9e430>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:54:18.249221 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-c37aefe7-bdf3-406a-af2a-c3dfd43855ae tempest-VolumesGetTestJSON-2114351129 tempest-VolumesGetTestJSON-2114351129-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/d3f772d4-2cc4-4a10-bfc5-c01ee0581bbe" status: 200 len: 352 microversion: 2.1 time: 0.358611 Jul 05 20:54:18.250058 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 2/2] 10.222.0.20 () {58 vars in 1244 bytes} [Tue Jul 5 20:54:17 2022] GET /compute/v2.1/os-volumes/d3f772d4-2cc4-4a10-bfc5-c01ee0581bbe => generated 352 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 05 20:54:18.347159 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-b1bc3bf5-91a2-4014-a760-155c0ce6bd3e tempest-VolumesSnapshotsTestJSON-685376017 tempest-VolumesSnapshotsTestJSON-685376017-project] 10.222.0.20 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 2.529184 Jul 05 20:54:18.349191 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 1/3] 10.222.0.20 () {60 vars in 1154 bytes} [Tue Jul 5 20:54:15 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 2533 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Jul 05 20:54:18.361885 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-30b38942-53ff-432a-a8fb-9870636b6770 tempest-VolumesSnapshotsTestJSON-685376017 tempest-VolumesSnapshotsTestJSON-685376017-project] Calling method '.version_select at 0x7f57cfe9e5e0>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:54:18.509675 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-30b38942-53ff-432a-a8fb-9870636b6770 tempest-VolumesSnapshotsTestJSON-685376017 tempest-VolumesSnapshotsTestJSON-685376017-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/29ea2f62-2ff9-4311-a010-d61585bf5d86" status: 200 len: 344 microversion: 2.1 time: 0.151505 Jul 05 20:54:18.510272 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 3/4] 10.222.0.20 () {58 vars in 1244 bytes} [Tue Jul 5 20:54:18 2022] GET /compute/v2.1/os-volumes/29ea2f62-2ff9-4311-a010-d61585bf5d86 => generated 344 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 20:54:18.866831 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-6024f3d3-f186-47e1-a90a-7ee690d21c77 tempest-VolumesTestJSON-180789062 tempest-VolumesTestJSON-180789062-project] Calling method '.version_select at 0x7f57cfea14c0>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:54:18.928194 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-6024f3d3-f186-47e1-a90a-7ee690d21c77 tempest-VolumesTestJSON-180789062 tempest-VolumesTestJSON-180789062-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/f30351df-027a-4844-83c5-4b1b2860c2eb" status: 200 len: 350 microversion: 2.1 time: 0.065957 Jul 05 20:54:18.928753 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 2/5] 10.222.0.20 () {58 vars in 1244 bytes} [Tue Jul 5 20:54:18 2022] GET /compute/v2.1/os-volumes/f30351df-027a-4844-83c5-4b1b2860c2eb => generated 350 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 05 20:54:19.263694 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-bb4e468f-e62b-48a5-af7f-83550c1a833c tempest-VolumesGetTestJSON-2114351129 tempest-VolumesGetTestJSON-2114351129-project] Calling method '.version_select at 0x7f57cfe9ec10>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:54:19.324677 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-bb4e468f-e62b-48a5-af7f-83550c1a833c tempest-VolumesGetTestJSON-2114351129 tempest-VolumesGetTestJSON-2114351129-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/d3f772d4-2cc4-4a10-bfc5-c01ee0581bbe" status: 200 len: 353 microversion: 2.1 time: 0.065700 Jul 05 20:54:19.325289 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 4/6] 10.222.0.20 () {58 vars in 1244 bytes} [Tue Jul 5 20:54:19 2022] GET /compute/v2.1/os-volumes/d3f772d4-2cc4-4a10-bfc5-c01ee0581bbe => generated 353 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 20:54:19.337446 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-873cbca3-7ad5-498f-9b74-4e5027bcd4ad tempest-VolumesGetTestJSON-2114351129 tempest-VolumesGetTestJSON-2114351129-project] Calling method '.version_select at 0x7f57cfea1820>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:54:19.526662 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-f5db8093-b0b6-4f7d-906b-4cd716718d83 tempest-VolumesSnapshotsTestJSON-685376017 tempest-VolumesSnapshotsTestJSON-685376017-project] Calling method '.version_select at 0x7f57cfeb2310>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:54:19.622495 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-873cbca3-7ad5-498f-9b74-4e5027bcd4ad tempest-VolumesGetTestJSON-2114351129 tempest-VolumesGetTestJSON-2114351129-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/d3f772d4-2cc4-4a10-bfc5-c01ee0581bbe" status: 200 len: 353 microversion: 2.1 time: 0.289617 Jul 05 20:54:19.623341 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 3/7] 10.222.0.20 () {58 vars in 1244 bytes} [Tue Jul 5 20:54:19 2022] GET /compute/v2.1/os-volumes/d3f772d4-2cc4-4a10-bfc5-c01ee0581bbe => generated 353 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 20:54:19.644273 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-eebd4323-1c84-4f5a-8c74-baa79713703b tempest-VolumesGetTestJSON-2114351129 tempest-VolumesGetTestJSON-2114351129-project] Calling method '.version_select at 0x7f57cfea1d30>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:54:19.690973 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-f5db8093-b0b6-4f7d-906b-4cd716718d83 tempest-VolumesSnapshotsTestJSON-685376017 tempest-VolumesSnapshotsTestJSON-685376017-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/29ea2f62-2ff9-4311-a010-d61585bf5d86" status: 200 len: 345 microversion: 2.1 time: 0.171520 Jul 05 20:54:19.698882 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 5/8] 10.222.0.20 () {58 vars in 1244 bytes} [Tue Jul 5 20:54:19 2022] GET /compute/v2.1/os-volumes/29ea2f62-2ff9-4311-a010-d61585bf5d86 => generated 345 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 20:54:19.707789 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-c9abb074-f3c5-4505-a86d-76ad5f0fd2cc tempest-VolumesSnapshotsTestJSON-685376017 tempest-VolumesSnapshotsTestJSON-685376017-project] Action: 'create', calling method: .version_select at 0x7f57cfe9ee50>, body: {"snapshot": {"volume_id": "29ea2f62-2ff9-4311-a010-d61585bf5d86", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-619337696"}} {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 20:54:19.832136 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-eebd4323-1c84-4f5a-8c74-baa79713703b tempest-VolumesGetTestJSON-2114351129 tempest-VolumesGetTestJSON-2114351129-project] 10.222.0.20 "DELETE /compute/v2.1/os-volumes/d3f772d4-2cc4-4a10-bfc5-c01ee0581bbe" status: 202 len: 0 microversion: 2.1 time: 0.192464 Jul 05 20:54:19.832853 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 4/9] 10.222.0.20 () {58 vars in 1247 bytes} [Tue Jul 5 20:54:19 2022] DELETE /compute/v2.1/os-volumes/d3f772d4-2cc4-4a10-bfc5-c01ee0581bbe => generated 0 bytes in 194 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 05 20:54:19.844568 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-4c38c862-e17a-465e-ae43-31e142738a20 tempest-VolumesGetTestJSON-2114351129 tempest-VolumesGetTestJSON-2114351129-project] Calling method '.version_select at 0x7f57cfebb430>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:54:20.086648 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-4c38c862-e17a-465e-ae43-31e142738a20 tempest-VolumesGetTestJSON-2114351129 tempest-VolumesGetTestJSON-2114351129-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/d3f772d4-2cc4-4a10-bfc5-c01ee0581bbe" status: 200 len: 352 microversion: 2.1 time: 0.248495 Jul 05 20:54:20.087204 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 5/10] 10.222.0.20 () {58 vars in 1244 bytes} [Tue Jul 5 20:54:19 2022] GET /compute/v2.1/os-volumes/d3f772d4-2cc4-4a10-bfc5-c01ee0581bbe => generated 352 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 20:54:20.353910 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-c9abb074-f3c5-4505-a86d-76ad5f0fd2cc tempest-VolumesSnapshotsTestJSON-685376017 tempest-VolumesSnapshotsTestJSON-685376017-project] 10.222.0.20 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.649863 Jul 05 20:54:20.361306 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 6/11] 10.222.0.20 () {60 vars in 1161 bytes} [Tue Jul 5 20:54:19 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 20:54:20.366056 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-2b433fa5-d5cd-4081-9f94-7e3dd277b42b tempest-VolumesSnapshotsTestJSON-685376017 tempest-VolumesSnapshotsTestJSON-685376017-project] Calling method '.version_select at 0x7f57cfea1d30>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:54:20.425479 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-2b433fa5-d5cd-4081-9f94-7e3dd277b42b tempest-VolumesSnapshotsTestJSON-685376017 tempest-VolumesSnapshotsTestJSON-685376017-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/87d3b7db-d277-4f94-8a37-b438e1ebcf48" status: 200 len: 286 microversion: 2.1 time: 0.064001 Jul 05 20:54:20.426349 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 6/12] 10.222.0.20 () {58 vars in 1250 bytes} [Tue Jul 5 20:54:20 2022] GET /compute/v2.1/os-snapshots/87d3b7db-d277-4f94-8a37-b438e1ebcf48 => generated 286 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 05 20:54:20.436593 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-7a84b0fe-2a4d-49be-b780-cbf82ed80546 tempest-VolumesSnapshotsTestJSON-685376017 tempest-VolumesSnapshotsTestJSON-685376017-project] Calling method '.version_select at 0x7f57cfeb2700>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:54:20.508318 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-7a84b0fe-2a4d-49be-b780-cbf82ed80546 tempest-VolumesSnapshotsTestJSON-685376017 tempest-VolumesSnapshotsTestJSON-685376017-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.075968 Jul 05 20:54:20.509169 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 7/13] 10.222.0.20 () {58 vars in 1139 bytes} [Tue Jul 5 20:54:20 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 05 20:54:20.520685 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-60d8baa7-2322-457c-bbad-c29bd805f43c tempest-VolumesSnapshotsTestJSON-685376017 tempest-VolumesSnapshotsTestJSON-685376017-project] Calling method '.version_select at 0x7f57cfea1af0>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:54:20.642330 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-60d8baa7-2322-457c-bbad-c29bd805f43c tempest-VolumesSnapshotsTestJSON-685376017 tempest-VolumesSnapshotsTestJSON-685376017-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/87d3b7db-d277-4f94-8a37-b438e1ebcf48" status: 200 len: 286 microversion: 2.1 time: 0.126004 Jul 05 20:54:20.643033 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-879505a3-ede1-42d4-a05e-fa68c7f24959 tempest-VolumesTestJSON-180789062 tempest-VolumesTestJSON-180789062-project] Calling method '.version_select at 0x7f57cfeb2e50>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:54:20.646796 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 7/14] 10.222.0.20 () {58 vars in 1250 bytes} [Tue Jul 5 20:54:20 2022] GET /compute/v2.1/os-snapshots/87d3b7db-d277-4f94-8a37-b438e1ebcf48 => generated 286 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 20:54:20.739298 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-879505a3-ede1-42d4-a05e-fa68c7f24959 tempest-VolumesTestJSON-180789062 tempest-VolumesTestJSON-180789062-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/9d76dd77-542e-4f32-a937-066f3687ed65" status: 200 len: 351 microversion: 2.1 time: 0.099876 Jul 05 20:54:20.741862 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 8/15] 10.222.0.20 () {58 vars in 1244 bytes} [Tue Jul 5 20:54:20 2022] GET /compute/v2.1/os-volumes/9d76dd77-542e-4f32-a937-066f3687ed65 => generated 351 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 20:54:21.098747 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-31e0f1a8-8615-45df-b8c2-a5abc49cb8c1 tempest-VolumesGetTestJSON-2114351129 tempest-VolumesGetTestJSON-2114351129-project] Calling method '.version_select at 0x7f57cfebb3a0>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:54:21.287287 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.wsgi [None req-31e0f1a8-8615-45df-b8c2-a5abc49cb8c1 tempest-VolumesGetTestJSON-2114351129 tempest-VolumesGetTestJSON-2114351129-project] HTTP exception thrown: Volume d3f772d4-2cc4-4a10-bfc5-c01ee0581bbe could not be found. Jul 05 20:54:21.293267 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-31e0f1a8-8615-45df-b8c2-a5abc49cb8c1 tempest-VolumesGetTestJSON-2114351129 tempest-VolumesGetTestJSON-2114351129-project] Request method failure captured: Jul 05 20:54:21.293267 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: request: GET /compute/v2.1/os-volumes/d3f772d4-2cc4-4a10-bfc5-c01ee0581bbe HTTP/1.1 Jul 05 20:54:21.293267 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: Accept: application/json Jul 05 20:54:21.293267 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: Accept-Encoding: identity Jul 05 20:54:21.293267 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: Connection: close Jul 05 20:54:21.293267 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: Content-Length: 0 Jul 05 20:54:21.293267 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: Content-Type: application/json Jul 05 20:54:21.293267 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: Host: 10.222.0.20 Jul 05 20:54:21.293267 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: Openstack-System-Scope: None Jul 05 20:54:21.293267 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: User-Agent: python-urllib3/1.26.9 Jul 05 20:54:21.293267 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Auth-Token: gAAAAABixKT2vmN2XI__ZlWCXu3tT77UP6VT81AfPN30nuXRKxApG3LSgxD5-j9Dqi4fb-HxHjwrfMeX_tXczq67lc55PPqQEqzaE14a9kMDbAppjys4Cvkov_yJBSZPFAgdKdpf5mEwiV8cuEzp_tryEvRGmFYlqvt9FX1Fq9YbcozGe571Hc4 Jul 05 20:54:21.293267 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Domain-Id: None Jul 05 20:54:21.293267 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Domain-Name: None Jul 05 20:54:21.293267 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Identity-Status: Confirmed Jul 05 20:54:21.293267 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Is-Admin-Project: True Jul 05 20:54:21.293267 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Project-Domain-Id: default Jul 05 20:54:21.293267 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Project-Domain-Name: Default Jul 05 20:54:21.293267 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Project-Id: 73388b11deda4e90a6ed52e6a1ef3bd3 Jul 05 20:54:21.293267 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Project-Name: tempest-VolumesGetTestJSON-2114351129 Jul 05 20:54:21.293267 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Role: member,reader Jul 05 20:54:21.293267 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Roles: member,reader Jul 05 20:54:21.294783 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/73388b11deda4e90a6ed52e6a1ef3bd3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/73388b11deda4e90a6ed52e6a1ef3bd3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_73388b11deda4e90a6ed52e6a1ef3bd3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/73388b11deda4e90a6ed52e6a1ef3bd3"}]}] Jul 05 20:54:21.294783 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Tenant: tempest-VolumesGetTestJSON-2114351129 Jul 05 20:54:21.294783 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Tenant-Id: 73388b11deda4e90a6ed52e6a1ef3bd3 Jul 05 20:54:21.294783 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Tenant-Name: tempest-VolumesGetTestJSON-2114351129 Jul 05 20:54:21.294783 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-User: tempest-VolumesGetTestJSON-2114351129-project Jul 05 20:54:21.294783 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-User-Domain-Id: default Jul 05 20:54:21.294783 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-User-Domain-Name: Default Jul 05 20:54:21.294783 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-User-Id: 4fb09a01017a430fa2f8e7d1e420cc3d Jul 05 20:54:21.294783 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-User-Name: tempest-VolumesGetTestJSON-2114351129-project Jul 05 20:54:21.294783 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: method: Jul 05 20:54:21.294783 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: exception: Volume d3f772d4-2cc4-4a10-bfc5-c01ee0581bbe could not be found. Jul 05 20:54:21.294783 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: action_args: {'id': 'd3f772d4-2cc4-4a10-bfc5-c01ee0581bbe'} Jul 05 20:54:21.294783 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 05 20:54:21.295721 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 20:54:21.295721 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 05 20:54:21.295721 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 05 20:54:21.295721 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 05 20:54:21.295721 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 05 20:54:21.295721 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 05 20:54:21.295721 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 05 20:54:21.295721 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 05 20:54:21.295721 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 05 20:54:21.295721 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 05 20:54:21.295721 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 05 20:54:21.295721 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 05 20:54:21.295721 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 05 20:54:21.295721 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 05 20:54:21.295721 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 05 20:54:21.295721 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume d3f772d4-2cc4-4a10-bfc5-c01ee0581bbe could not be found. (HTTP 404) (Request-ID: req-5ba6492e-49bb-43fa-a39e-8a5ed2018e0a) Jul 05 20:54:21.295721 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi Jul 05 20:54:21.295721 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 20:54:21.295721 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi Jul 05 20:54:21.298892 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 20:54:21.298892 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 05 20:54:21.298892 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 05 20:54:21.298892 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 05 20:54:21.298892 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 05 20:54:21.298892 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 05 20:54:21.298892 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 05 20:54:21.298892 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 05 20:54:21.298892 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 05 20:54:21.298892 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 05 20:54:21.298892 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 05 20:54:21.298892 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 05 20:54:21.298892 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 05 20:54:21.298892 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 05 20:54:21.298892 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 05 20:54:21.298892 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 05 20:54:21.298892 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 05 20:54:21.298892 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 05 20:54:21.298892 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 05 20:54:21.300607 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 05 20:54:21.300607 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 05 20:54:21.300607 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 05 20:54:21.300607 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 05 20:54:21.300607 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume d3f772d4-2cc4-4a10-bfc5-c01ee0581bbe could not be found. Jul 05 20:54:21.300607 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi Jul 05 20:54:21.300607 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 20:54:21.300607 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi Jul 05 20:54:21.300607 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 20:54:21.300607 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 20:54:21.300607 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 20:54:21.300607 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 05 20:54:21.300607 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 05 20:54:21.300607 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 05 20:54:21.300607 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 05 20:54:21.300607 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 05 20:54:21.300607 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 05 20:54:21.300607 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 05 20:54:21.300607 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 05 20:54:21.303135 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume d3f772d4-2cc4-4a10-bfc5-c01ee0581bbe could not be found. Jul 05 20:54:21.303135 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi Jul 05 20:54:21.303135 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 20:54:21.303135 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi Jul 05 20:54:21.303135 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 20:54:21.303135 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 20:54:21.303135 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 20:54:21.303135 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 05 20:54:21.303135 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 05 20:54:21.303135 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume d3f772d4-2cc4-4a10-bfc5-c01ee0581bbe could not be found. Jul 05 20:54:21.303135 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi Jul 05 20:54:21.303135 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-31e0f1a8-8615-45df-b8c2-a5abc49cb8c1 tempest-VolumesGetTestJSON-2114351129 tempest-VolumesGetTestJSON-2114351129-project] Returning 404 to user: Volume d3f772d4-2cc4-4a10-bfc5-c01ee0581bbe could not be found. {{(pid=117628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 05 20:54:21.303135 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-31e0f1a8-8615-45df-b8c2-a5abc49cb8c1 tempest-VolumesGetTestJSON-2114351129 tempest-VolumesGetTestJSON-2114351129-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/d3f772d4-2cc4-4a10-bfc5-c01ee0581bbe" status: 404 len: 109 microversion: 2.1 time: 0.200176 Jul 05 20:54:21.303135 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 8/16] 10.222.0.20 () {58 vars in 1244 bytes} [Tue Jul 5 20:54:21 2022] GET /compute/v2.1/os-volumes/d3f772d4-2cc4-4a10-bfc5-c01ee0581bbe => generated 109 bytes in 202 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 05 20:54:21.654087 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-60820e6c-4f5e-4e77-a89b-67b82299ef2d tempest-VolumesSnapshotsTestJSON-685376017 tempest-VolumesSnapshotsTestJSON-685376017-project] Calling method '.version_select at 0x7f57cfeb2ca0>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:54:21.741368 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-60820e6c-4f5e-4e77-a89b-67b82299ef2d tempest-VolumesSnapshotsTestJSON-685376017 tempest-VolumesSnapshotsTestJSON-685376017-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/87d3b7db-d277-4f94-8a37-b438e1ebcf48" status: 200 len: 286 microversion: 2.1 time: 0.091203 Jul 05 20:54:21.742261 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 9/17] 10.222.0.20 () {58 vars in 1250 bytes} [Tue Jul 5 20:54:21 2022] GET /compute/v2.1/os-snapshots/87d3b7db-d277-4f94-8a37-b438e1ebcf48 => generated 286 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 20:54:22.754376 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-b94e175e-57e3-43df-bbce-dc0dafb2e7a8 tempest-VolumesSnapshotsTestJSON-685376017 tempest-VolumesSnapshotsTestJSON-685376017-project] Calling method '.version_select at 0x7f57cfea19d0>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:54:22.818404 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-b94e175e-57e3-43df-bbce-dc0dafb2e7a8 tempest-VolumesSnapshotsTestJSON-685376017 tempest-VolumesSnapshotsTestJSON-685376017-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/87d3b7db-d277-4f94-8a37-b438e1ebcf48" status: 200 len: 286 microversion: 2.1 time: 0.068521 Jul 05 20:54:22.818955 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 9/18] 10.222.0.20 () {58 vars in 1250 bytes} [Tue Jul 5 20:54:22 2022] GET /compute/v2.1/os-snapshots/87d3b7db-d277-4f94-8a37-b438e1ebcf48 => generated 286 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 20:54:23.831565 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-7d24b387-d2ff-461e-ab0d-758febad3a1c tempest-VolumesSnapshotsTestJSON-685376017 tempest-VolumesSnapshotsTestJSON-685376017-project] Calling method '.version_select at 0x7f57cfe275e0>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:54:23.889540 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-7d24b387-d2ff-461e-ab0d-758febad3a1c tempest-VolumesSnapshotsTestJSON-685376017 tempest-VolumesSnapshotsTestJSON-685376017-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/87d3b7db-d277-4f94-8a37-b438e1ebcf48" status: 200 len: 287 microversion: 2.1 time: 0.063329 Jul 05 20:54:23.890101 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 10/19] 10.222.0.20 () {58 vars in 1250 bytes} [Tue Jul 5 20:54:23 2022] GET /compute/v2.1/os-snapshots/87d3b7db-d277-4f94-8a37-b438e1ebcf48 => generated 287 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 20:54:23.900720 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-316a3cc1-5df8-45e8-96d0-fa8a398614ef tempest-VolumesSnapshotsTestJSON-685376017 tempest-VolumesSnapshotsTestJSON-685376017-project] Calling method '.version_select at 0x7f57cfebb8b0>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:54:24.039840 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-ed658830-3bed-4c26-bdd8-183af63cdfe0 tempest-DeleteServersTestJSON-389510094 tempest-DeleteServersTestJSON-389510094-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1693106532", "imageRef": "88e08f49-c01d-4849-a89f-b678588e56f4", "flavorRef": "452", "networks": [{"uuid": "996b084e-85fc-481a-a65a-82ee24abc8d9"}]}} {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 20:54:24.099302 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-316a3cc1-5df8-45e8-96d0-fa8a398614ef tempest-VolumesSnapshotsTestJSON-685376017 tempest-VolumesSnapshotsTestJSON-685376017-project] 10.222.0.20 "DELETE /compute/v2.1/os-snapshots/87d3b7db-d277-4f94-8a37-b438e1ebcf48" status: 202 len: 0 microversion: 2.1 time: 0.202040 Jul 05 20:54:24.099877 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 11/20] 10.222.0.20 () {58 vars in 1253 bytes} [Tue Jul 5 20:54:23 2022] DELETE /compute/v2.1/os-snapshots/87d3b7db-d277-4f94-8a37-b438e1ebcf48 => generated 0 bytes in 204 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 05 20:54:24.108790 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-27a7ce88-e5d1-4ac1-b716-3ab2b25f55b9 tempest-VolumesSnapshotsTestJSON-685376017 tempest-VolumesSnapshotsTestJSON-685376017-project] Calling method '.version_select at 0x7f57cfea1a60>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:54:24.166211 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-27a7ce88-e5d1-4ac1-b716-3ab2b25f55b9 tempest-VolumesSnapshotsTestJSON-685376017 tempest-VolumesSnapshotsTestJSON-685376017-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/87d3b7db-d277-4f94-8a37-b438e1ebcf48" status: 200 len: 286 microversion: 2.1 time: 0.060907 Jul 05 20:54:24.167401 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 12/21] 10.222.0.20 () {58 vars in 1250 bytes} [Tue Jul 5 20:54:24 2022] GET /compute/v2.1/os-snapshots/87d3b7db-d277-4f94-8a37-b438e1ebcf48 => generated 286 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 05 20:54:24.309890 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.network.neutron [None req-ed658830-3bed-4c26-bdd8-183af63cdfe0 tempest-DeleteServersTestJSON-389510094 tempest-DeleteServersTestJSON-389510094-project] validate_networks() for [('996b084e-85fc-481a-a65a-82ee24abc8d9', None, None, None, None, None)] {{(pid=117627) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 05 20:54:24.715825 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-51eafb14-7027-44da-b4ab-1587c926a63e tempest-VolumesTestJSON-180789062 tempest-VolumesTestJSON-180789062-project] Calling method '.version_select at 0x7f57cfe27310>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:54:24.836633 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-51eafb14-7027-44da-b4ab-1587c926a63e tempest-VolumesTestJSON-180789062 tempest-VolumesTestJSON-180789062-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/6ce68e6e-3da5-4c24-b977-35cb6b4eb0a1" status: 200 len: 350 microversion: 2.1 time: 0.125077 Jul 05 20:54:24.838221 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 13/22] 10.222.0.20 () {58 vars in 1244 bytes} [Tue Jul 5 20:54:24 2022] GET /compute/v2.1/os-volumes/6ce68e6e-3da5-4c24-b977-35cb6b4eb0a1 => generated 350 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 20:54:24.851702 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-17b44bc3-f09d-456a-9e64-06bb1321937b tempest-VolumesTestJSON-180789062 tempest-VolumesTestJSON-180789062-project] Calling method '.version_select at 0x7f57cfe27c10>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:54:25.060534 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-17b44bc3-f09d-456a-9e64-06bb1321937b tempest-VolumesTestJSON-180789062 tempest-VolumesTestJSON-180789062-project] 10.222.0.20 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.214330 Jul 05 20:54:25.061131 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 14/23] 10.222.0.20 () {58 vars in 1133 bytes} [Tue Jul 5 20:54:24 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 20:54:25.075860 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-b5693713-b844-4835-ba35-d76a9d662ba2 tempest-VolumesTestJSON-180789062 tempest-VolumesTestJSON-180789062-project] Calling method '.version_select at 0x7f57cfe27f70>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:54:25.314618 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-b5693713-b844-4835-ba35-d76a9d662ba2 tempest-VolumesTestJSON-180789062 tempest-VolumesTestJSON-180789062-project] 10.222.0.20 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.240791 Jul 05 20:54:25.315957 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 15/24] 10.222.0.20 () {58 vars in 1148 bytes} [Tue Jul 5 20:54:25 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 05 20:54:25.330248 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-bb02aaf9-facf-4c60-80bf-210e87a42690 tempest-VolumesSnapshotsTestJSON-685376017 tempest-VolumesSnapshotsTestJSON-685376017-project] Calling method '.version_select at 0x7f57cfea1550>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:54:25.389760 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.wsgi [None req-bb02aaf9-facf-4c60-80bf-210e87a42690 tempest-VolumesSnapshotsTestJSON-685376017 tempest-VolumesSnapshotsTestJSON-685376017-project] HTTP exception thrown: Snapshot 87d3b7db-d277-4f94-8a37-b438e1ebcf48 could not be found. Jul 05 20:54:25.393268 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-bb02aaf9-facf-4c60-80bf-210e87a42690 tempest-VolumesSnapshotsTestJSON-685376017 tempest-VolumesSnapshotsTestJSON-685376017-project] Request method failure captured: Jul 05 20:54:25.393268 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: request: GET /compute/v2.1/os-snapshots/87d3b7db-d277-4f94-8a37-b438e1ebcf48 HTTP/1.1 Jul 05 20:54:25.393268 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: Accept: application/json Jul 05 20:54:25.393268 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: Accept-Encoding: identity Jul 05 20:54:25.393268 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: Connection: close Jul 05 20:54:25.393268 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: Content-Length: 0 Jul 05 20:54:25.393268 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: Content-Type: application/json Jul 05 20:54:25.393268 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: Host: 10.222.0.20 Jul 05 20:54:25.393268 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: Openstack-System-Scope: None Jul 05 20:54:25.393268 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: User-Agent: python-urllib3/1.26.9 Jul 05 20:54:25.393268 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Auth-Token: gAAAAABixKT31GlZUwzRj9TrloUSE7r5d9BPsN3YqrOgako3Qi-u0rlTVKU77hJ5I5EyMZuPHpHvB0mcsSG1DfU7EiQg9E2Nq33DrwFAm_QKoYYbj5K9F17_lAHXhtdFOWahubt-4TfRFNnhP0tNrOoLouBjFqH1-qkLyol2_EY8-HKY2a_Bx-8 Jul 05 20:54:25.393268 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Domain-Id: None Jul 05 20:54:25.393268 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Domain-Name: None Jul 05 20:54:25.393268 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Identity-Status: Confirmed Jul 05 20:54:25.393268 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Is-Admin-Project: True Jul 05 20:54:25.393268 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Project-Domain-Id: default Jul 05 20:54:25.393268 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Project-Domain-Name: Default Jul 05 20:54:25.393268 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Project-Id: ce0fdcac2fc84876bb72a68abaa107ab Jul 05 20:54:25.393268 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-685376017 Jul 05 20:54:25.393268 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Role: member,reader Jul 05 20:54:25.393268 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Roles: member,reader Jul 05 20:54:25.394912 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ce0fdcac2fc84876bb72a68abaa107ab"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/ce0fdcac2fc84876bb72a68abaa107ab"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_ce0fdcac2fc84876bb72a68abaa107ab"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ce0fdcac2fc84876bb72a68abaa107ab"}]}] Jul 05 20:54:25.394912 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Tenant: tempest-VolumesSnapshotsTestJSON-685376017 Jul 05 20:54:25.394912 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Tenant-Id: ce0fdcac2fc84876bb72a68abaa107ab Jul 05 20:54:25.394912 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-685376017 Jul 05 20:54:25.394912 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-User: tempest-VolumesSnapshotsTestJSON-685376017-project Jul 05 20:54:25.394912 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-User-Domain-Id: default Jul 05 20:54:25.394912 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-User-Domain-Name: Default Jul 05 20:54:25.394912 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-User-Id: ac77bdee7e0c40e69f40b510aed8258b Jul 05 20:54:25.394912 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-User-Name: tempest-VolumesSnapshotsTestJSON-685376017-project Jul 05 20:54:25.394912 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: method: Jul 05 20:54:25.394912 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: exception: Snapshot 87d3b7db-d277-4f94-8a37-b438e1ebcf48 could not be found. Jul 05 20:54:25.394912 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: action_args: {'id': '87d3b7db-d277-4f94-8a37-b438e1ebcf48'} Jul 05 20:54:25.394912 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 05 20:54:25.396360 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 20:54:25.396360 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 05 20:54:25.396360 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 05 20:54:25.396360 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 05 20:54:25.396360 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 05 20:54:25.396360 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 05 20:54:25.396360 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 05 20:54:25.396360 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 05 20:54:25.396360 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 05 20:54:25.396360 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 05 20:54:25.396360 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 05 20:54:25.396360 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 05 20:54:25.396360 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 05 20:54:25.396360 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 05 20:54:25.396360 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 05 20:54:25.396360 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 87d3b7db-d277-4f94-8a37-b438e1ebcf48 could not be found. (HTTP 404) (Request-ID: req-9cf52121-704f-474d-baee-37483a4fefc8) Jul 05 20:54:25.396360 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi Jul 05 20:54:25.396360 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 20:54:25.398008 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi Jul 05 20:54:25.398008 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 20:54:25.398008 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jul 05 20:54:25.398008 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jul 05 20:54:25.398008 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 05 20:54:25.398008 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 05 20:54:25.398008 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jul 05 20:54:25.398008 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jul 05 20:54:25.398008 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 05 20:54:25.398008 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 05 20:54:25.398008 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 05 20:54:25.398008 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 05 20:54:25.398008 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 05 20:54:25.398008 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 05 20:54:25.398008 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 05 20:54:25.398008 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 05 20:54:25.398008 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 05 20:54:25.398008 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 05 20:54:25.398008 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 05 20:54:25.400124 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 05 20:54:25.400124 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 05 20:54:25.400124 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 05 20:54:25.400124 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 05 20:54:25.400124 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 05 20:54:25.400124 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 87d3b7db-d277-4f94-8a37-b438e1ebcf48 could not be found. Jul 05 20:54:25.400124 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi Jul 05 20:54:25.400124 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 20:54:25.400124 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi Jul 05 20:54:25.400124 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 20:54:25.400124 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 20:54:25.400124 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 20:54:25.400124 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 05 20:54:25.400124 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 05 20:54:25.400124 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 05 20:54:25.400124 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 05 20:54:25.400124 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 05 20:54:25.400124 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 05 20:54:25.400124 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jul 05 20:54:25.400124 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 05 20:54:25.402540 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 87d3b7db-d277-4f94-8a37-b438e1ebcf48 could not be found. Jul 05 20:54:25.402540 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi Jul 05 20:54:25.402540 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 20:54:25.402540 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi Jul 05 20:54:25.402540 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 20:54:25.402540 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 20:54:25.402540 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 20:54:25.402540 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 05 20:54:25.402540 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 05 20:54:25.402540 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 87d3b7db-d277-4f94-8a37-b438e1ebcf48 could not be found. Jul 05 20:54:25.402540 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi Jul 05 20:54:25.406875 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-bb02aaf9-facf-4c60-80bf-210e87a42690 tempest-VolumesSnapshotsTestJSON-685376017 tempest-VolumesSnapshotsTestJSON-685376017-project] Returning 404 to user: Snapshot 87d3b7db-d277-4f94-8a37-b438e1ebcf48 could not be found. {{(pid=117628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 05 20:54:25.408180 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-bb02aaf9-facf-4c60-80bf-210e87a42690 tempest-VolumesSnapshotsTestJSON-685376017 tempest-VolumesSnapshotsTestJSON-685376017-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/87d3b7db-d277-4f94-8a37-b438e1ebcf48" status: 404 len: 111 microversion: 2.1 time: 0.089526 Jul 05 20:54:25.409326 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 16/25] 10.222.0.20 () {58 vars in 1250 bytes} [Tue Jul 5 20:54:25 2022] GET /compute/v2.1/os-snapshots/87d3b7db-d277-4f94-8a37-b438e1ebcf48 => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 05 20:54:25.439940 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-9b67a270-c476-4906-9828-a52474c9a941 tempest-VolumesTestJSON-180789062 tempest-VolumesTestJSON-180789062-project] Calling method '.version_select at 0x7f57d08829d0>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:54:25.757308 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-9b67a270-c476-4906-9828-a52474c9a941 tempest-VolumesTestJSON-180789062 tempest-VolumesTestJSON-180789062-project] 10.222.0.20 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.345999 Jul 05 20:54:25.759798 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 17/26] 10.222.0.20 () {58 vars in 1133 bytes} [Tue Jul 5 20:54:25 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 20:54:25.770685 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-9ce502f9-3730-4651-81fc-6358b866f07a tempest-VolumesSnapshotsTestJSON-685376017 tempest-VolumesSnapshotsTestJSON-685376017-project] Calling method '.version_select at 0x7f57cfe27ca0>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:54:25.945737 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-9ce502f9-3730-4651-81fc-6358b866f07a tempest-VolumesSnapshotsTestJSON-685376017 tempest-VolumesSnapshotsTestJSON-685376017-project] 10.222.0.20 "DELETE /compute/v2.1/os-volumes/29ea2f62-2ff9-4311-a010-d61585bf5d86" status: 202 len: 0 microversion: 2.1 time: 0.184690 Jul 05 20:54:25.946411 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 18/27] 10.222.0.20 () {58 vars in 1247 bytes} [Tue Jul 5 20:54:25 2022] DELETE /compute/v2.1/os-volumes/29ea2f62-2ff9-4311-a010-d61585bf5d86 => generated 0 bytes in 186 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 05 20:54:25.954861 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-12be2f5d-5d64-4c16-8893-19e60524950a tempest-VolumesTestJSON-180789062 tempest-VolumesTestJSON-180789062-project] Calling method '.version_select at 0x7f57cfebb8b0>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:54:26.146189 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-12be2f5d-5d64-4c16-8893-19e60524950a tempest-VolumesTestJSON-180789062 tempest-VolumesTestJSON-180789062-project] 10.222.0.20 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.195854 Jul 05 20:54:26.154961 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 19/28] 10.222.0.20 () {58 vars in 1166 bytes} [Tue Jul 5 20:54:25 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 20:54:26.161587 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-089c0896-7a92-4868-b9d6-db2179d1481c tempest-VolumesSnapshotsTestJSON-685376017 tempest-VolumesSnapshotsTestJSON-685376017-project] Calling method '.version_select at 0x7f57cfe298b0>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:54:26.234614 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.wsgi [None req-089c0896-7a92-4868-b9d6-db2179d1481c tempest-VolumesSnapshotsTestJSON-685376017 tempest-VolumesSnapshotsTestJSON-685376017-project] HTTP exception thrown: Volume 29ea2f62-2ff9-4311-a010-d61585bf5d86 could not be found. Jul 05 20:54:26.237752 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-089c0896-7a92-4868-b9d6-db2179d1481c tempest-VolumesSnapshotsTestJSON-685376017 tempest-VolumesSnapshotsTestJSON-685376017-project] Request method failure captured: Jul 05 20:54:26.237752 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: request: GET /compute/v2.1/os-volumes/29ea2f62-2ff9-4311-a010-d61585bf5d86 HTTP/1.1 Jul 05 20:54:26.237752 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: Accept: application/json Jul 05 20:54:26.237752 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: Accept-Encoding: identity Jul 05 20:54:26.237752 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: Connection: close Jul 05 20:54:26.237752 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: Content-Length: 0 Jul 05 20:54:26.237752 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: Content-Type: application/json Jul 05 20:54:26.237752 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: Host: 10.222.0.20 Jul 05 20:54:26.237752 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: Openstack-System-Scope: None Jul 05 20:54:26.237752 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: User-Agent: python-urllib3/1.26.9 Jul 05 20:54:26.237752 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Auth-Token: gAAAAABixKT31GlZUwzRj9TrloUSE7r5d9BPsN3YqrOgako3Qi-u0rlTVKU77hJ5I5EyMZuPHpHvB0mcsSG1DfU7EiQg9E2Nq33DrwFAm_QKoYYbj5K9F17_lAHXhtdFOWahubt-4TfRFNnhP0tNrOoLouBjFqH1-qkLyol2_EY8-HKY2a_Bx-8 Jul 05 20:54:26.237752 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Domain-Id: None Jul 05 20:54:26.237752 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Domain-Name: None Jul 05 20:54:26.237752 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Identity-Status: Confirmed Jul 05 20:54:26.237752 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Is-Admin-Project: True Jul 05 20:54:26.237752 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Project-Domain-Id: default Jul 05 20:54:26.237752 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Project-Domain-Name: Default Jul 05 20:54:26.237752 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Project-Id: ce0fdcac2fc84876bb72a68abaa107ab Jul 05 20:54:26.237752 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-685376017 Jul 05 20:54:26.237752 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Role: member,reader Jul 05 20:54:26.237752 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Roles: member,reader Jul 05 20:54:26.239034 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ce0fdcac2fc84876bb72a68abaa107ab"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/ce0fdcac2fc84876bb72a68abaa107ab"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_ce0fdcac2fc84876bb72a68abaa107ab"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ce0fdcac2fc84876bb72a68abaa107ab"}]}] Jul 05 20:54:26.239034 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Tenant: tempest-VolumesSnapshotsTestJSON-685376017 Jul 05 20:54:26.239034 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Tenant-Id: ce0fdcac2fc84876bb72a68abaa107ab Jul 05 20:54:26.239034 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-685376017 Jul 05 20:54:26.239034 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-User: tempest-VolumesSnapshotsTestJSON-685376017-project Jul 05 20:54:26.239034 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-User-Domain-Id: default Jul 05 20:54:26.239034 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-User-Domain-Name: Default Jul 05 20:54:26.239034 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-User-Id: ac77bdee7e0c40e69f40b510aed8258b Jul 05 20:54:26.239034 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-User-Name: tempest-VolumesSnapshotsTestJSON-685376017-project Jul 05 20:54:26.239034 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: method: Jul 05 20:54:26.239034 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: exception: Volume 29ea2f62-2ff9-4311-a010-d61585bf5d86 could not be found. Jul 05 20:54:26.239034 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: action_args: {'id': '29ea2f62-2ff9-4311-a010-d61585bf5d86'} Jul 05 20:54:26.239034 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 05 20:54:26.239976 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 20:54:26.239976 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 05 20:54:26.239976 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 05 20:54:26.239976 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 05 20:54:26.239976 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 05 20:54:26.239976 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 05 20:54:26.239976 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 05 20:54:26.239976 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 05 20:54:26.239976 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 05 20:54:26.239976 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 05 20:54:26.239976 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 05 20:54:26.239976 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 05 20:54:26.239976 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 05 20:54:26.239976 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 05 20:54:26.239976 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 05 20:54:26.239976 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 29ea2f62-2ff9-4311-a010-d61585bf5d86 could not be found. (HTTP 404) (Request-ID: req-11406db0-ffe0-48cb-945c-1fc66f528f01) Jul 05 20:54:26.239976 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi Jul 05 20:54:26.239976 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 20:54:26.239976 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi Jul 05 20:54:26.241175 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 20:54:26.241175 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 05 20:54:26.241175 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 05 20:54:26.241175 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 05 20:54:26.241175 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 05 20:54:26.241175 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 05 20:54:26.241175 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 05 20:54:26.241175 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 05 20:54:26.241175 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 05 20:54:26.241175 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 05 20:54:26.241175 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 05 20:54:26.241175 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 05 20:54:26.241175 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 05 20:54:26.241175 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 05 20:54:26.241175 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 05 20:54:26.241175 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 05 20:54:26.241175 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 05 20:54:26.241175 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 05 20:54:26.241175 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 05 20:54:26.242190 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 05 20:54:26.242190 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 05 20:54:26.242190 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 05 20:54:26.242190 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 05 20:54:26.242190 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 29ea2f62-2ff9-4311-a010-d61585bf5d86 could not be found. Jul 05 20:54:26.242190 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi Jul 05 20:54:26.242190 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 20:54:26.242190 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi Jul 05 20:54:26.242190 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 20:54:26.242190 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 20:54:26.242190 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 20:54:26.242190 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 05 20:54:26.242190 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 05 20:54:26.242190 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 05 20:54:26.242190 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 05 20:54:26.242190 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 05 20:54:26.242190 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 05 20:54:26.242190 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 05 20:54:26.242190 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 05 20:54:26.243292 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 29ea2f62-2ff9-4311-a010-d61585bf5d86 could not be found. Jul 05 20:54:26.243292 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi Jul 05 20:54:26.243292 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 20:54:26.243292 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi Jul 05 20:54:26.243292 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 20:54:26.243292 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 20:54:26.243292 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 20:54:26.243292 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 05 20:54:26.243292 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 05 20:54:26.243292 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 29ea2f62-2ff9-4311-a010-d61585bf5d86 could not be found. Jul 05 20:54:26.243292 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi Jul 05 20:54:26.244885 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.virt.hardware [None req-ed658830-3bed-4c26-bdd8-183af63cdfe0 tempest-DeleteServersTestJSON-389510094 tempest-DeleteServersTestJSON-389510094-project] Flavor limits 0:0:0 {{(pid=117627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 05 20:54:26.245440 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.virt.hardware [None req-ed658830-3bed-4c26-bdd8-183af63cdfe0 tempest-DeleteServersTestJSON-389510094 tempest-DeleteServersTestJSON-389510094-project] Image limits 0:0:0 {{(pid=117627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 05 20:54:26.245864 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-089c0896-7a92-4868-b9d6-db2179d1481c tempest-VolumesSnapshotsTestJSON-685376017 tempest-VolumesSnapshotsTestJSON-685376017-project] Returning 404 to user: Volume 29ea2f62-2ff9-4311-a010-d61585bf5d86 could not be found. {{(pid=117628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 05 20:54:26.246149 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.virt.hardware [None req-ed658830-3bed-4c26-bdd8-183af63cdfe0 tempest-DeleteServersTestJSON-389510094 tempest-DeleteServersTestJSON-389510094-project] Flavor pref 0:0:0 {{(pid=117627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 05 20:54:26.246808 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.virt.hardware [None req-ed658830-3bed-4c26-bdd8-183af63cdfe0 tempest-DeleteServersTestJSON-389510094 tempest-DeleteServersTestJSON-389510094-project] Image pref 0:0:0 {{(pid=117627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 05 20:54:26.247354 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.virt.hardware [None req-ed658830-3bed-4c26-bdd8-183af63cdfe0 tempest-DeleteServersTestJSON-389510094 tempest-DeleteServersTestJSON-389510094-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 05 20:54:26.247873 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-089c0896-7a92-4868-b9d6-db2179d1481c tempest-VolumesSnapshotsTestJSON-685376017 tempest-VolumesSnapshotsTestJSON-685376017-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/29ea2f62-2ff9-4311-a010-d61585bf5d86" status: 404 len: 109 microversion: 2.1 time: 0.091247 Jul 05 20:54:26.248584 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 20/29] 10.222.0.20 () {58 vars in 1244 bytes} [Tue Jul 5 20:54:26 2022] GET /compute/v2.1/os-volumes/29ea2f62-2ff9-4311-a010-d61585bf5d86 => generated 109 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 05 20:54:26.265153 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-ed658830-3bed-4c26-bdd8-183af63cdfe0 tempest-DeleteServersTestJSON-389510094 tempest-DeleteServersTestJSON-389510094-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:54:26.265813 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-808678ab-1fd7-4a0b-8c54-b86ad402edfe tempest-VolumesTestJSON-180789062 tempest-VolumesTestJSON-180789062-project] Calling method '.version_select at 0x7f57cfe27e50>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:54:26.266192 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-ed658830-3bed-4c26-bdd8-183af63cdfe0 tempest-DeleteServersTestJSON-389510094 tempest-DeleteServersTestJSON-389510094-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:54:26.267369 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-ed658830-3bed-4c26-bdd8-183af63cdfe0 tempest-DeleteServersTestJSON-389510094 tempest-DeleteServersTestJSON-389510094-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:54:26.268017 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-ed658830-3bed-4c26-bdd8-183af63cdfe0 tempest-DeleteServersTestJSON-389510094 tempest-DeleteServersTestJSON-389510094-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:54:26.320640 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.quota [None req-ed658830-3bed-4c26-bdd8-183af63cdfe0 tempest-DeleteServersTestJSON-389510094 tempest-DeleteServersTestJSON-389510094-project] Getting quotas for project 873a5ea6741e4762857e2bae05f5e06d. Resources: {'cores', 'ram', 'instances'} {{(pid=117627) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 05 20:54:26.327736 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.quota [None req-ed658830-3bed-4c26-bdd8-183af63cdfe0 tempest-DeleteServersTestJSON-389510094 tempest-DeleteServersTestJSON-389510094-project] Getting quotas for user 5063db22225a4d0b97ec5dcac8770045 and project 873a5ea6741e4762857e2bae05f5e06d. Resources: {'cores', 'ram', 'instances'} {{(pid=117627) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 05 20:54:26.355460 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-ed658830-3bed-4c26-bdd8-183af63cdfe0 tempest-DeleteServersTestJSON-389510094 tempest-DeleteServersTestJSON-389510094-project] Going to run 1 instances... {{(pid=117627) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 05 20:54:26.365671 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-ed658830-3bed-4c26-bdd8-183af63cdfe0 tempest-DeleteServersTestJSON-389510094 tempest-DeleteServersTestJSON-389510094-project] [instance: 1159954e-7c69-48d8-b051-5a7b1108da69] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='88e08f49-c01d-4849-a89f-b678588e56f4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117627) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 05 20:54:26.480909 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-808678ab-1fd7-4a0b-8c54-b86ad402edfe tempest-VolumesTestJSON-180789062 tempest-VolumesTestJSON-180789062-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.231121 Jul 05 20:54:26.482677 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 21/30] 10.222.0.20 () {58 vars in 1169 bytes} [Tue Jul 5 20:54:26 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 20:54:26.494908 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-fff83c3a-07c1-4773-80e1-2f26bd0b69c4 tempest-VolumesSnapshotsTestJSON-685376017 tempest-VolumesSnapshotsTestJSON-685376017-project] Calling method '.version_select at 0x7f57cfea14c0>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:54:26.549623 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.wsgi [None req-fff83c3a-07c1-4773-80e1-2f26bd0b69c4 tempest-VolumesSnapshotsTestJSON-685376017 tempest-VolumesSnapshotsTestJSON-685376017-project] HTTP exception thrown: Volume 29ea2f62-2ff9-4311-a010-d61585bf5d86 could not be found. Jul 05 20:54:26.552898 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-fff83c3a-07c1-4773-80e1-2f26bd0b69c4 tempest-VolumesSnapshotsTestJSON-685376017 tempest-VolumesSnapshotsTestJSON-685376017-project] Request method failure captured: Jul 05 20:54:26.552898 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: request: DELETE /compute/v2.1/os-volumes/29ea2f62-2ff9-4311-a010-d61585bf5d86 HTTP/1.1 Jul 05 20:54:26.552898 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: Accept: application/json Jul 05 20:54:26.552898 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: Accept-Encoding: identity Jul 05 20:54:26.552898 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: Connection: close Jul 05 20:54:26.552898 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: Content-Length: 0 Jul 05 20:54:26.552898 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: Content-Type: application/json Jul 05 20:54:26.552898 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: Host: 10.222.0.20 Jul 05 20:54:26.552898 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: Openstack-System-Scope: None Jul 05 20:54:26.552898 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: User-Agent: python-urllib3/1.26.9 Jul 05 20:54:26.552898 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Auth-Token: gAAAAABixKT31GlZUwzRj9TrloUSE7r5d9BPsN3YqrOgako3Qi-u0rlTVKU77hJ5I5EyMZuPHpHvB0mcsSG1DfU7EiQg9E2Nq33DrwFAm_QKoYYbj5K9F17_lAHXhtdFOWahubt-4TfRFNnhP0tNrOoLouBjFqH1-qkLyol2_EY8-HKY2a_Bx-8 Jul 05 20:54:26.552898 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Domain-Id: None Jul 05 20:54:26.552898 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Domain-Name: None Jul 05 20:54:26.552898 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Identity-Status: Confirmed Jul 05 20:54:26.552898 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Is-Admin-Project: True Jul 05 20:54:26.552898 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Project-Domain-Id: default Jul 05 20:54:26.552898 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Project-Domain-Name: Default Jul 05 20:54:26.552898 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Project-Id: ce0fdcac2fc84876bb72a68abaa107ab Jul 05 20:54:26.552898 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-685376017 Jul 05 20:54:26.552898 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Role: member,reader Jul 05 20:54:26.552898 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Roles: member,reader Jul 05 20:54:26.554007 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ce0fdcac2fc84876bb72a68abaa107ab"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/ce0fdcac2fc84876bb72a68abaa107ab"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_ce0fdcac2fc84876bb72a68abaa107ab"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ce0fdcac2fc84876bb72a68abaa107ab"}]}] Jul 05 20:54:26.554007 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Tenant: tempest-VolumesSnapshotsTestJSON-685376017 Jul 05 20:54:26.554007 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Tenant-Id: ce0fdcac2fc84876bb72a68abaa107ab Jul 05 20:54:26.554007 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-685376017 Jul 05 20:54:26.554007 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-User: tempest-VolumesSnapshotsTestJSON-685376017-project Jul 05 20:54:26.554007 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-User-Domain-Id: default Jul 05 20:54:26.554007 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-User-Domain-Name: Default Jul 05 20:54:26.554007 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-User-Id: ac77bdee7e0c40e69f40b510aed8258b Jul 05 20:54:26.554007 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-User-Name: tempest-VolumesSnapshotsTestJSON-685376017-project Jul 05 20:54:26.554007 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: method: Jul 05 20:54:26.554007 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: exception: Volume 29ea2f62-2ff9-4311-a010-d61585bf5d86 could not be found. Jul 05 20:54:26.554007 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: action_args: {'id': '29ea2f62-2ff9-4311-a010-d61585bf5d86'} Jul 05 20:54:26.554007 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 05 20:54:26.554624 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 20:54:26.554624 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 05 20:54:26.554624 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 05 20:54:26.554624 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 05 20:54:26.554624 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 05 20:54:26.554624 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 05 20:54:26.554624 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 05 20:54:26.554624 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 05 20:54:26.554624 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 05 20:54:26.554624 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 05 20:54:26.554624 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 05 20:54:26.554624 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 05 20:54:26.554624 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 05 20:54:26.554624 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 05 20:54:26.554624 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 05 20:54:26.554624 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 29ea2f62-2ff9-4311-a010-d61585bf5d86 could not be found. (HTTP 404) (Request-ID: req-2f91db3b-be70-4eaf-858b-9deed3b7d13d) Jul 05 20:54:26.554624 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi Jul 05 20:54:26.554624 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 20:54:26.554624 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi Jul 05 20:54:26.555599 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 20:54:26.555599 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 05 20:54:26.555599 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 05 20:54:26.555599 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 05 20:54:26.555599 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 05 20:54:26.555599 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 05 20:54:26.555599 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 05 20:54:26.555599 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 05 20:54:26.555599 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 05 20:54:26.555599 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 05 20:54:26.555599 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 05 20:54:26.555599 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 05 20:54:26.555599 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 05 20:54:26.555599 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 05 20:54:26.555599 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 05 20:54:26.555599 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 05 20:54:26.555599 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 05 20:54:26.555599 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 05 20:54:26.555599 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 05 20:54:26.556507 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 05 20:54:26.556507 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 05 20:54:26.556507 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 05 20:54:26.556507 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 05 20:54:26.556507 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 29ea2f62-2ff9-4311-a010-d61585bf5d86 could not be found. Jul 05 20:54:26.556507 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi Jul 05 20:54:26.556507 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 20:54:26.556507 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi Jul 05 20:54:26.556507 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 20:54:26.556507 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 20:54:26.556507 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 20:54:26.556507 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 05 20:54:26.556507 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 05 20:54:26.556507 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 05 20:54:26.556507 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 05 20:54:26.556507 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 05 20:54:26.556507 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 05 20:54:26.556507 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 05 20:54:26.556507 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 05 20:54:26.562325 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 29ea2f62-2ff9-4311-a010-d61585bf5d86 could not be found. Jul 05 20:54:26.562325 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi Jul 05 20:54:26.562325 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 20:54:26.562325 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi Jul 05 20:54:26.562325 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 20:54:26.562325 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 20:54:26.562325 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 20:54:26.562325 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 05 20:54:26.562325 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 05 20:54:26.562325 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 29ea2f62-2ff9-4311-a010-d61585bf5d86 could not be found. Jul 05 20:54:26.562325 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi Jul 05 20:54:26.562325 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-fff83c3a-07c1-4773-80e1-2f26bd0b69c4 tempest-VolumesSnapshotsTestJSON-685376017 tempest-VolumesSnapshotsTestJSON-685376017-project] Returning 404 to user: Volume 29ea2f62-2ff9-4311-a010-d61585bf5d86 could not be found. {{(pid=117628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 05 20:54:26.562325 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-fff83c3a-07c1-4773-80e1-2f26bd0b69c4 tempest-VolumesSnapshotsTestJSON-685376017 tempest-VolumesSnapshotsTestJSON-685376017-project] 10.222.0.20 "DELETE /compute/v2.1/os-volumes/29ea2f62-2ff9-4311-a010-d61585bf5d86" status: 404 len: 109 microversion: 2.1 time: 0.072570 Jul 05 20:54:26.562325 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 22/31] 10.222.0.20 () {58 vars in 1247 bytes} [Tue Jul 5 20:54:26 2022] DELETE /compute/v2.1/os-volumes/29ea2f62-2ff9-4311-a010-d61585bf5d86 => generated 109 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 05 20:54:26.572857 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-03ec6c8c-8951-40d5-bf6f-3f42b3c9335e tempest-VolumesTestJSON-180789062 tempest-VolumesTestJSON-180789062-project] Calling method '.version_select at 0x7f57cfe27790>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:54:26.606666 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-ed658830-3bed-4c26-bdd8-183af63cdfe0 tempest-DeleteServersTestJSON-389510094 tempest-DeleteServersTestJSON-389510094-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.858792 Jul 05 20:54:26.608997 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 10/32] 10.222.0.20 () {60 vars in 1146 bytes} [Tue Jul 5 20:54:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 2864 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 05 20:54:26.620023 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-b1d2eeb5-a5b3-4bee-bb0e-ebd4e74883ee tempest-VolumesSnapshotsTestJSON-685376017 tempest-VolumesSnapshotsTestJSON-685376017-project] Calling method '.version_select at 0x7f57cfdb1f70>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:54:26.711717 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.wsgi [None req-b1d2eeb5-a5b3-4bee-bb0e-ebd4e74883ee tempest-VolumesSnapshotsTestJSON-685376017 tempest-VolumesSnapshotsTestJSON-685376017-project] HTTP exception thrown: Volume 29ea2f62-2ff9-4311-a010-d61585bf5d86 could not be found. Jul 05 20:54:26.717000 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-b1d2eeb5-a5b3-4bee-bb0e-ebd4e74883ee tempest-VolumesSnapshotsTestJSON-685376017 tempest-VolumesSnapshotsTestJSON-685376017-project] Request method failure captured: Jul 05 20:54:26.717000 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: request: GET /compute/v2.1/os-volumes/29ea2f62-2ff9-4311-a010-d61585bf5d86 HTTP/1.1 Jul 05 20:54:26.717000 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: Accept: application/json Jul 05 20:54:26.717000 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: Accept-Encoding: identity Jul 05 20:54:26.717000 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: Connection: close Jul 05 20:54:26.717000 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: Content-Length: 0 Jul 05 20:54:26.717000 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: Content-Type: application/json Jul 05 20:54:26.717000 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: Host: 10.222.0.20 Jul 05 20:54:26.717000 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: Openstack-System-Scope: None Jul 05 20:54:26.717000 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: User-Agent: python-urllib3/1.26.9 Jul 05 20:54:26.717000 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Auth-Token: gAAAAABixKT31GlZUwzRj9TrloUSE7r5d9BPsN3YqrOgako3Qi-u0rlTVKU77hJ5I5EyMZuPHpHvB0mcsSG1DfU7EiQg9E2Nq33DrwFAm_QKoYYbj5K9F17_lAHXhtdFOWahubt-4TfRFNnhP0tNrOoLouBjFqH1-qkLyol2_EY8-HKY2a_Bx-8 Jul 05 20:54:26.717000 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Domain-Id: None Jul 05 20:54:26.717000 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Domain-Name: None Jul 05 20:54:26.717000 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Identity-Status: Confirmed Jul 05 20:54:26.717000 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Is-Admin-Project: True Jul 05 20:54:26.717000 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Project-Domain-Id: default Jul 05 20:54:26.717000 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Project-Domain-Name: Default Jul 05 20:54:26.717000 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Project-Id: ce0fdcac2fc84876bb72a68abaa107ab Jul 05 20:54:26.717000 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-685376017 Jul 05 20:54:26.717000 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Role: member,reader Jul 05 20:54:26.717000 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Roles: member,reader Jul 05 20:54:26.718161 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ce0fdcac2fc84876bb72a68abaa107ab"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/ce0fdcac2fc84876bb72a68abaa107ab"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_ce0fdcac2fc84876bb72a68abaa107ab"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ce0fdcac2fc84876bb72a68abaa107ab"}]}] Jul 05 20:54:26.718161 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Tenant: tempest-VolumesSnapshotsTestJSON-685376017 Jul 05 20:54:26.718161 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Tenant-Id: ce0fdcac2fc84876bb72a68abaa107ab Jul 05 20:54:26.718161 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-685376017 Jul 05 20:54:26.718161 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-User: tempest-VolumesSnapshotsTestJSON-685376017-project Jul 05 20:54:26.718161 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-User-Domain-Id: default Jul 05 20:54:26.718161 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-User-Domain-Name: Default Jul 05 20:54:26.718161 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-User-Id: ac77bdee7e0c40e69f40b510aed8258b Jul 05 20:54:26.718161 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-User-Name: tempest-VolumesSnapshotsTestJSON-685376017-project Jul 05 20:54:26.718161 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: method: Jul 05 20:54:26.718161 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: exception: Volume 29ea2f62-2ff9-4311-a010-d61585bf5d86 could not be found. Jul 05 20:54:26.718161 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: action_args: {'id': '29ea2f62-2ff9-4311-a010-d61585bf5d86'} Jul 05 20:54:26.718161 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 05 20:54:26.718844 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 20:54:26.718844 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 05 20:54:26.718844 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 05 20:54:26.718844 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 05 20:54:26.718844 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 05 20:54:26.718844 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 05 20:54:26.718844 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 05 20:54:26.718844 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 05 20:54:26.718844 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 05 20:54:26.718844 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 05 20:54:26.718844 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 05 20:54:26.718844 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 05 20:54:26.718844 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 05 20:54:26.718844 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 05 20:54:26.718844 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 05 20:54:26.718844 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 29ea2f62-2ff9-4311-a010-d61585bf5d86 could not be found. (HTTP 404) (Request-ID: req-4b528c62-6279-4c86-a69a-14ac937dadbd) Jul 05 20:54:26.718844 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi Jul 05 20:54:26.718844 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 20:54:26.718844 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi Jul 05 20:54:26.719733 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 20:54:26.719733 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 05 20:54:26.719733 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 05 20:54:26.719733 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 05 20:54:26.719733 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 05 20:54:26.719733 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 05 20:54:26.719733 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 05 20:54:26.719733 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 05 20:54:26.719733 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 05 20:54:26.719733 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 05 20:54:26.719733 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 05 20:54:26.719733 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 05 20:54:26.719733 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 05 20:54:26.719733 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 05 20:54:26.719733 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 05 20:54:26.719733 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 05 20:54:26.719733 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 05 20:54:26.719733 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 05 20:54:26.719733 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 05 20:54:26.720620 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 05 20:54:26.720620 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 05 20:54:26.720620 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 05 20:54:26.720620 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 05 20:54:26.720620 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 29ea2f62-2ff9-4311-a010-d61585bf5d86 could not be found. Jul 05 20:54:26.720620 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi Jul 05 20:54:26.720620 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 20:54:26.720620 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi Jul 05 20:54:26.720620 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 20:54:26.720620 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 20:54:26.720620 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 20:54:26.720620 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 05 20:54:26.720620 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 05 20:54:26.720620 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 05 20:54:26.720620 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 05 20:54:26.720620 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 05 20:54:26.720620 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 05 20:54:26.720620 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 05 20:54:26.720620 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 05 20:54:26.721556 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 29ea2f62-2ff9-4311-a010-d61585bf5d86 could not be found. Jul 05 20:54:26.721556 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi Jul 05 20:54:26.721556 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 20:54:26.721556 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi Jul 05 20:54:26.721556 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 20:54:26.721556 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 20:54:26.721556 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 20:54:26.721556 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 05 20:54:26.721556 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 05 20:54:26.721556 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 29ea2f62-2ff9-4311-a010-d61585bf5d86 could not be found. Jul 05 20:54:26.721556 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi Jul 05 20:54:26.721556 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-b1d2eeb5-a5b3-4bee-bb0e-ebd4e74883ee tempest-VolumesSnapshotsTestJSON-685376017 tempest-VolumesSnapshotsTestJSON-685376017-project] Returning 404 to user: Volume 29ea2f62-2ff9-4311-a010-d61585bf5d86 could not be found. {{(pid=117627) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 05 20:54:26.721556 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-b1d2eeb5-a5b3-4bee-bb0e-ebd4e74883ee tempest-VolumesSnapshotsTestJSON-685376017 tempest-VolumesSnapshotsTestJSON-685376017-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/29ea2f62-2ff9-4311-a010-d61585bf5d86" status: 404 len: 109 microversion: 2.1 time: 0.107523 Jul 05 20:54:26.721556 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 11/33] 10.222.0.20 () {58 vars in 1244 bytes} [Tue Jul 5 20:54:26 2022] GET /compute/v2.1/os-volumes/29ea2f62-2ff9-4311-a010-d61585bf5d86 => generated 109 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 05 20:54:26.734539 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-b59b89d2-3ef7-4024-9378-09b48d565746 tempest-DeleteServersTestJSON-389510094 tempest-DeleteServersTestJSON-389510094-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:54:26.736973 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-b59b89d2-3ef7-4024-9378-09b48d565746 tempest-DeleteServersTestJSON-389510094 tempest-DeleteServersTestJSON-389510094-project] [instance: 1159954e-7c69-48d8-b051-5a7b1108da69] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:54:26.980339 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-03ec6c8c-8951-40d5-bf6f-3f42b3c9335e tempest-VolumesTestJSON-180789062 tempest-VolumesTestJSON-180789062-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.418817 Jul 05 20:54:26.981953 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 23/34] 10.222.0.20 () {58 vars in 1154 bytes} [Tue Jul 5 20:54:26 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 20:54:26.998682 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-003eed76-114c-4f1e-b081-a342bdf1b5ae tempest-VolumesTestJSON-180789062 tempest-VolumesTestJSON-180789062-project] Calling method '.version_select at 0x7f57cfebb670>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:54:27.113014 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-b59b89d2-3ef7-4024-9378-09b48d565746 tempest-DeleteServersTestJSON-389510094 tempest-DeleteServersTestJSON-389510094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5063db22225a4d0b97ec5dcac8770045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '873a5ea6741e4762857e2bae05f5e06d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:54:27.140742 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-b59b89d2-3ef7-4024-9378-09b48d565746 tempest-DeleteServersTestJSON-389510094 tempest-DeleteServersTestJSON-389510094-project] 10.222.0.20 "GET /compute/v2.1/servers/1159954e-7c69-48d8-b051-5a7b1108da69" status: 200 len: 1215 microversion: 2.1 time: 0.417386 Jul 05 20:54:27.153858 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 12/35] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:54:26 2022] GET /compute/v2.1/servers/1159954e-7c69-48d8-b051-5a7b1108da69 => generated 1215 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 20:54:27.275403 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-003eed76-114c-4f1e-b081-a342bdf1b5ae tempest-VolumesTestJSON-180789062 tempest-VolumesTestJSON-180789062-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.282830 Jul 05 20:54:27.278594 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 24/36] 10.222.0.20 () {58 vars in 1187 bytes} [Tue Jul 5 20:54:26 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 05 20:54:27.291386 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-847df06a-ee78-46d7-b188-91be24e6d806 tempest-VolumesTestJSON-180789062 tempest-VolumesTestJSON-180789062-project] Calling method '.version_select at 0x7f57ced3e4c0>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:54:27.518784 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-847df06a-ee78-46d7-b188-91be24e6d806 tempest-VolumesTestJSON-180789062 tempest-VolumesTestJSON-180789062-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.231629 Jul 05 20:54:27.519574 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 13/37] 10.222.0.20 () {58 vars in 1154 bytes} [Tue Jul 5 20:54:27 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 20:54:28.171112 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-13547cc2-9119-4046-927e-aaffd4da862a tempest-DeleteServersTestJSON-389510094 tempest-DeleteServersTestJSON-389510094-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:54:28.171859 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-13547cc2-9119-4046-927e-aaffd4da862a tempest-DeleteServersTestJSON-389510094 tempest-DeleteServersTestJSON-389510094-project] [instance: 1159954e-7c69-48d8-b051-5a7b1108da69] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:54:28.619962 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-13547cc2-9119-4046-927e-aaffd4da862a tempest-DeleteServersTestJSON-389510094 tempest-DeleteServersTestJSON-389510094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5063db22225a4d0b97ec5dcac8770045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '873a5ea6741e4762857e2bae05f5e06d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:54:28.655916 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-13547cc2-9119-4046-927e-aaffd4da862a tempest-DeleteServersTestJSON-389510094 tempest-DeleteServersTestJSON-389510094-project] 10.222.0.20 "GET /compute/v2.1/servers/1159954e-7c69-48d8-b051-5a7b1108da69" status: 200 len: 1215 microversion: 2.1 time: 0.486323 Jul 05 20:54:28.657169 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 25/38] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:54:28 2022] GET /compute/v2.1/servers/1159954e-7c69-48d8-b051-5a7b1108da69 => generated 1215 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 20:54:29.675725 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-82a928aa-97bc-4f86-9243-1a7ab651bc98 tempest-DeleteServersTestJSON-389510094 tempest-DeleteServersTestJSON-389510094-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:54:29.677664 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-82a928aa-97bc-4f86-9243-1a7ab651bc98 tempest-DeleteServersTestJSON-389510094 tempest-DeleteServersTestJSON-389510094-project] [instance: 1159954e-7c69-48d8-b051-5a7b1108da69] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:54:29.713101 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-82a928aa-97bc-4f86-9243-1a7ab651bc98 tempest-DeleteServersTestJSON-389510094 tempest-DeleteServersTestJSON-389510094-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:54:29.714197 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-82a928aa-97bc-4f86-9243-1a7ab651bc98 tempest-DeleteServersTestJSON-389510094 tempest-DeleteServersTestJSON-389510094-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:54:29.716158 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-82a928aa-97bc-4f86-9243-1a7ab651bc98 tempest-DeleteServersTestJSON-389510094 tempest-DeleteServersTestJSON-389510094-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:54:29.717912 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-82a928aa-97bc-4f86-9243-1a7ab651bc98 tempest-DeleteServersTestJSON-389510094 tempest-DeleteServersTestJSON-389510094-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:54:30.796876 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-82a928aa-97bc-4f86-9243-1a7ab651bc98 tempest-DeleteServersTestJSON-389510094 tempest-DeleteServersTestJSON-389510094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5063db22225a4d0b97ec5dcac8770045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '873a5ea6741e4762857e2bae05f5e06d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:54:30.822984 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-82a928aa-97bc-4f86-9243-1a7ab651bc98 tempest-DeleteServersTestJSON-389510094 tempest-DeleteServersTestJSON-389510094-project] 10.222.0.20 "GET /compute/v2.1/servers/1159954e-7c69-48d8-b051-5a7b1108da69" status: 200 len: 1219 microversion: 2.1 time: 1.152475 Jul 05 20:54:30.832975 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 14/39] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:54:29 2022] GET /compute/v2.1/servers/1159954e-7c69-48d8-b051-5a7b1108da69 => generated 1219 bytes in 1163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 20:54:31.311419 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-faa136da-0139-4d86-81c8-975c76e1d640 tempest-VolumesNegativeTest-1885713757 tempest-VolumesNegativeTest-1885713757-project] Action: 'create', calling method: .version_select at 0x7f57cfe29430>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1495628077", "metadata": {"Type": "work"}}} {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 20:54:31.338183 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-faa136da-0139-4d86-81c8-975c76e1d640 tempest-VolumesNegativeTest-1885713757 tempest-VolumesNegativeTest-1885713757-project] Request method failure captured: Jul 05 20:54:31.338183 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 05 20:54:31.338183 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: Accept: application/json Jul 05 20:54:31.338183 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: Accept-Encoding: identity Jul 05 20:54:31.338183 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: Connection: close Jul 05 20:54:31.338183 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: Content-Length: 122 Jul 05 20:54:31.338183 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: Content-Type: application/json Jul 05 20:54:31.338183 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: Host: 10.222.0.20 Jul 05 20:54:31.338183 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: Openstack-System-Scope: None Jul 05 20:54:31.338183 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: User-Agent: python-urllib3/1.26.9 Jul 05 20:54:31.338183 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Auth-Token: gAAAAABixKUGZ2uRiR-ceCOIzo3Euoke3CXf8I3aMyJxHNjR-obQtrVV-kJqJGOCWeVrKOLqSTdTOizLunCNrWhUDzLyXXUnWmxRokkcePzsvhrZL6frg7V8c-41PuS0dWDT7qUD2fRLPb7aQPNvIL86ufuRGOib4TF7F5zD9HvYqDH3s_TXX2Y Jul 05 20:54:31.338183 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Domain-Id: None Jul 05 20:54:31.338183 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Domain-Name: None Jul 05 20:54:31.338183 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Identity-Status: Confirmed Jul 05 20:54:31.338183 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Is-Admin-Project: True Jul 05 20:54:31.338183 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Project-Domain-Id: default Jul 05 20:54:31.338183 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Project-Domain-Name: Default Jul 05 20:54:31.338183 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Project-Id: cc1ab9cbfa8a455f8802af5122b3daa0 Jul 05 20:54:31.338183 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Project-Name: tempest-VolumesNegativeTest-1885713757 Jul 05 20:54:31.338183 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Role: member,reader Jul 05 20:54:31.338183 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Roles: member,reader Jul 05 20:54:31.339515 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/cc1ab9cbfa8a455f8802af5122b3daa0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/cc1ab9cbfa8a455f8802af5122b3daa0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_cc1ab9cbfa8a455f8802af5122b3daa0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/cc1ab9cbfa8a455f8802af5122b3daa0"}]}] Jul 05 20:54:31.339515 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Tenant: tempest-VolumesNegativeTest-1885713757 Jul 05 20:54:31.339515 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Tenant-Id: cc1ab9cbfa8a455f8802af5122b3daa0 Jul 05 20:54:31.339515 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Tenant-Name: tempest-VolumesNegativeTest-1885713757 Jul 05 20:54:31.339515 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-User: tempest-VolumesNegativeTest-1885713757-project Jul 05 20:54:31.339515 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-User-Domain-Id: default Jul 05 20:54:31.339515 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-User-Domain-Name: Default Jul 05 20:54:31.339515 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-User-Id: 8d661e8ac05f4e4d8d8cc806d47d8f51 Jul 05 20:54:31.339515 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-User-Name: tempest-VolumesNegativeTest-1885713757-project Jul 05 20:54:31.339515 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: Jul 05 20:54:31.339515 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1495628077", "metadata": {"Type": "work"}}} Jul 05 20:54:31.339515 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: method: Jul 05 20:54:31.339515 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 05 20:54:31.340227 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1495628077', 'metadata': {'Type': 'work'}}}} Jul 05 20:54:31.340227 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 05 20:54:31.340227 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 20:54:31.340227 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 05 20:54:31.340227 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 05 20:54:31.340227 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 05 20:54:31.340227 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi raise error Jul 05 20:54:31.340227 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jul 05 20:54:31.340227 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi Jul 05 20:54:31.340227 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 05 20:54:31.340227 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 05 20:54:31.340227 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi Jul 05 20:54:31.340227 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 05 20:54:31.340227 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi '#$%' Jul 05 20:54:31.340227 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi Jul 05 20:54:31.340227 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 20:54:31.340227 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi Jul 05 20:54:31.340227 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 20:54:31.340227 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 20:54:31.340227 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 20:54:31.340227 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 05 20:54:31.340227 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 05 20:54:31.341415 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 05 20:54:31.341415 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 05 20:54:31.341415 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 05 20:54:31.341415 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 05 20:54:31.341415 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 05 20:54:31.341415 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 05 20:54:31.341415 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 05 20:54:31.341415 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 05 20:54:31.341415 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 05 20:54:31.341415 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 05 20:54:31.341415 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 05 20:54:31.341415 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi Jul 05 20:54:31.341415 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 20:54:31.341415 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi Jul 05 20:54:31.341415 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 20:54:31.341415 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 20:54:31.341415 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 20:54:31.341415 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 05 20:54:31.341415 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 05 20:54:31.342384 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 05 20:54:31.342384 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi Jul 05 20:54:31.344191 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-faa136da-0139-4d86-81c8-975c76e1d640 tempest-VolumesNegativeTest-1885713757 tempest-VolumesNegativeTest-1885713757-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=117628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 05 20:54:31.345291 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-faa136da-0139-4d86-81c8-975c76e1d640 tempest-VolumesNegativeTest-1885713757 tempest-VolumesNegativeTest-1885713757-project] 10.222.0.20 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.282689 Jul 05 20:54:31.346792 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 26/40] 10.222.0.20 () {60 vars in 1155 bytes} [Tue Jul 5 20:54:31 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 284 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 05 20:54:31.357563 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-ec5c6fff-380a-4603-8235-d9fb0a3298e2 tempest-VolumesNegativeTest-1885713757 tempest-VolumesNegativeTest-1885713757-project] Action: 'create', calling method: .version_select at 0x7f57cecbe8b0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1152596660", "metadata": {"Type": "work"}}} {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 20:54:31.361572 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-ec5c6fff-380a-4603-8235-d9fb0a3298e2 tempest-VolumesNegativeTest-1885713757 tempest-VolumesNegativeTest-1885713757-project] Request method failure captured: Jul 05 20:54:31.361572 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 05 20:54:31.361572 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: Accept: application/json Jul 05 20:54:31.361572 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: Accept-Encoding: identity Jul 05 20:54:31.361572 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: Connection: close Jul 05 20:54:31.361572 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: Content-Length: 120 Jul 05 20:54:31.361572 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: Content-Type: application/json Jul 05 20:54:31.361572 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: Host: 10.222.0.20 Jul 05 20:54:31.361572 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: Openstack-System-Scope: None Jul 05 20:54:31.361572 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: User-Agent: python-urllib3/1.26.9 Jul 05 20:54:31.361572 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Auth-Token: gAAAAABixKUGZ2uRiR-ceCOIzo3Euoke3CXf8I3aMyJxHNjR-obQtrVV-kJqJGOCWeVrKOLqSTdTOizLunCNrWhUDzLyXXUnWmxRokkcePzsvhrZL6frg7V8c-41PuS0dWDT7qUD2fRLPb7aQPNvIL86ufuRGOib4TF7F5zD9HvYqDH3s_TXX2Y Jul 05 20:54:31.361572 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Domain-Id: None Jul 05 20:54:31.361572 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Domain-Name: None Jul 05 20:54:31.361572 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Identity-Status: Confirmed Jul 05 20:54:31.361572 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Is-Admin-Project: True Jul 05 20:54:31.361572 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Project-Domain-Id: default Jul 05 20:54:31.361572 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Project-Domain-Name: Default Jul 05 20:54:31.361572 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Project-Id: cc1ab9cbfa8a455f8802af5122b3daa0 Jul 05 20:54:31.361572 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Project-Name: tempest-VolumesNegativeTest-1885713757 Jul 05 20:54:31.361572 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Role: member,reader Jul 05 20:54:31.361572 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Roles: member,reader Jul 05 20:54:31.362716 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/cc1ab9cbfa8a455f8802af5122b3daa0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/cc1ab9cbfa8a455f8802af5122b3daa0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_cc1ab9cbfa8a455f8802af5122b3daa0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/cc1ab9cbfa8a455f8802af5122b3daa0"}]}] Jul 05 20:54:31.362716 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Tenant: tempest-VolumesNegativeTest-1885713757 Jul 05 20:54:31.362716 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Tenant-Id: cc1ab9cbfa8a455f8802af5122b3daa0 Jul 05 20:54:31.362716 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Tenant-Name: tempest-VolumesNegativeTest-1885713757 Jul 05 20:54:31.362716 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-User: tempest-VolumesNegativeTest-1885713757-project Jul 05 20:54:31.362716 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-User-Domain-Id: default Jul 05 20:54:31.362716 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-User-Domain-Name: Default Jul 05 20:54:31.362716 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-User-Id: 8d661e8ac05f4e4d8d8cc806d47d8f51 Jul 05 20:54:31.362716 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-User-Name: tempest-VolumesNegativeTest-1885713757-project Jul 05 20:54:31.362716 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: Jul 05 20:54:31.362716 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1152596660", "metadata": {"Type": "work"}}} Jul 05 20:54:31.362716 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: method: Jul 05 20:54:31.362716 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 05 20:54:31.363605 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1152596660', 'metadata': {'Type': 'work'}}}} Jul 05 20:54:31.363605 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 05 20:54:31.363605 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 20:54:31.363605 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 05 20:54:31.363605 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 05 20:54:31.363605 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 05 20:54:31.363605 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi raise error Jul 05 20:54:31.363605 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jul 05 20:54:31.363605 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi Jul 05 20:54:31.363605 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jul 05 20:54:31.363605 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 05 20:54:31.363605 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi Jul 05 20:54:31.363605 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 05 20:54:31.363605 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi '0' Jul 05 20:54:31.363605 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi Jul 05 20:54:31.363605 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 20:54:31.363605 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi Jul 05 20:54:31.363605 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 20:54:31.363605 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 20:54:31.363605 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 20:54:31.363605 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 05 20:54:31.363605 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 05 20:54:31.364899 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 05 20:54:31.364899 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 05 20:54:31.364899 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 05 20:54:31.364899 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 05 20:54:31.364899 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 05 20:54:31.364899 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 05 20:54:31.364899 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 05 20:54:31.364899 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 05 20:54:31.364899 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 05 20:54:31.364899 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 05 20:54:31.364899 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 05 20:54:31.364899 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi Jul 05 20:54:31.364899 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 20:54:31.364899 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi Jul 05 20:54:31.364899 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 20:54:31.364899 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 20:54:31.364899 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 20:54:31.364899 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 05 20:54:31.364899 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 05 20:54:31.365870 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 05 20:54:31.365870 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi Jul 05 20:54:31.368785 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-ec5c6fff-380a-4603-8235-d9fb0a3298e2 tempest-VolumesNegativeTest-1885713757 tempest-VolumesNegativeTest-1885713757-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=117627) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 05 20:54:31.386169 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-ec5c6fff-380a-4603-8235-d9fb0a3298e2 tempest-VolumesNegativeTest-1885713757 tempest-VolumesNegativeTest-1885713757-project] 10.222.0.20 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.021636 Jul 05 20:54:31.387984 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 15/41] 10.222.0.20 () {60 vars in 1155 bytes} [Tue Jul 5 20:54:31 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 36 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 05 20:54:31.402228 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-c312111c-2119-4cbc-bd49-b04666f84a6f tempest-VolumesNegativeTest-1885713757 tempest-VolumesNegativeTest-1885713757-project] Action: 'create', calling method: .version_select at 0x7f57cfdee700>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-2088046614", "metadata": {"Type": "work"}}} {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 20:54:31.406582 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-c312111c-2119-4cbc-bd49-b04666f84a6f tempest-VolumesNegativeTest-1885713757 tempest-VolumesNegativeTest-1885713757-project] Request method failure captured: Jul 05 20:54:31.406582 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 05 20:54:31.406582 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: Accept: application/json Jul 05 20:54:31.406582 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: Accept-Encoding: identity Jul 05 20:54:31.406582 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: Connection: close Jul 05 20:54:31.406582 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: Content-Length: 119 Jul 05 20:54:31.406582 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: Content-Type: application/json Jul 05 20:54:31.406582 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: Host: 10.222.0.20 Jul 05 20:54:31.406582 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: Openstack-System-Scope: None Jul 05 20:54:31.406582 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: User-Agent: python-urllib3/1.26.9 Jul 05 20:54:31.406582 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Auth-Token: gAAAAABixKUGZ2uRiR-ceCOIzo3Euoke3CXf8I3aMyJxHNjR-obQtrVV-kJqJGOCWeVrKOLqSTdTOizLunCNrWhUDzLyXXUnWmxRokkcePzsvhrZL6frg7V8c-41PuS0dWDT7qUD2fRLPb7aQPNvIL86ufuRGOib4TF7F5zD9HvYqDH3s_TXX2Y Jul 05 20:54:31.406582 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Domain-Id: None Jul 05 20:54:31.406582 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Domain-Name: None Jul 05 20:54:31.406582 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Identity-Status: Confirmed Jul 05 20:54:31.406582 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Is-Admin-Project: True Jul 05 20:54:31.406582 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Project-Domain-Id: default Jul 05 20:54:31.406582 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Project-Domain-Name: Default Jul 05 20:54:31.406582 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Project-Id: cc1ab9cbfa8a455f8802af5122b3daa0 Jul 05 20:54:31.406582 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Project-Name: tempest-VolumesNegativeTest-1885713757 Jul 05 20:54:31.406582 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Role: member,reader Jul 05 20:54:31.406582 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Roles: member,reader Jul 05 20:54:31.407637 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/cc1ab9cbfa8a455f8802af5122b3daa0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/cc1ab9cbfa8a455f8802af5122b3daa0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_cc1ab9cbfa8a455f8802af5122b3daa0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/cc1ab9cbfa8a455f8802af5122b3daa0"}]}] Jul 05 20:54:31.407637 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Tenant: tempest-VolumesNegativeTest-1885713757 Jul 05 20:54:31.407637 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Tenant-Id: cc1ab9cbfa8a455f8802af5122b3daa0 Jul 05 20:54:31.407637 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Tenant-Name: tempest-VolumesNegativeTest-1885713757 Jul 05 20:54:31.407637 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-User: tempest-VolumesNegativeTest-1885713757-project Jul 05 20:54:31.407637 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-User-Domain-Id: default Jul 05 20:54:31.407637 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-User-Domain-Name: Default Jul 05 20:54:31.407637 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-User-Id: 8d661e8ac05f4e4d8d8cc806d47d8f51 Jul 05 20:54:31.407637 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-User-Name: tempest-VolumesNegativeTest-1885713757-project Jul 05 20:54:31.407637 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: Jul 05 20:54:31.407637 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-2088046614", "metadata": {"Type": "work"}}} Jul 05 20:54:31.407637 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: method: Jul 05 20:54:31.407637 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 05 20:54:31.408265 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-2088046614', 'metadata': {'Type': 'work'}}}} Jul 05 20:54:31.408265 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 05 20:54:31.408265 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 20:54:31.408265 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 05 20:54:31.408265 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 05 20:54:31.408265 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 05 20:54:31.408265 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi raise error Jul 05 20:54:31.408265 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jul 05 20:54:31.408265 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi Jul 05 20:54:31.408265 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 05 20:54:31.408265 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 05 20:54:31.408265 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi Jul 05 20:54:31.408265 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 05 20:54:31.408265 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi '' Jul 05 20:54:31.408265 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi Jul 05 20:54:31.408265 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 20:54:31.408265 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi Jul 05 20:54:31.408265 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 20:54:31.408265 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 20:54:31.408265 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 20:54:31.408265 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 05 20:54:31.408265 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 05 20:54:31.409385 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 05 20:54:31.409385 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 05 20:54:31.409385 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 05 20:54:31.409385 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 05 20:54:31.409385 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 05 20:54:31.409385 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 05 20:54:31.409385 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 05 20:54:31.409385 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 05 20:54:31.409385 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 05 20:54:31.409385 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 05 20:54:31.409385 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 05 20:54:31.409385 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi Jul 05 20:54:31.409385 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 20:54:31.409385 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi Jul 05 20:54:31.409385 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 20:54:31.409385 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 20:54:31.409385 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 20:54:31.409385 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 05 20:54:31.409385 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 05 20:54:31.410306 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 05 20:54:31.410306 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi Jul 05 20:54:31.413657 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-c312111c-2119-4cbc-bd49-b04666f84a6f tempest-VolumesNegativeTest-1885713757 tempest-VolumesNegativeTest-1885713757-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=117628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 05 20:54:31.414949 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-c312111c-2119-4cbc-bd49-b04666f84a6f tempest-VolumesNegativeTest-1885713757 tempest-VolumesNegativeTest-1885713757-project] 10.222.0.20 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.018156 Jul 05 20:54:31.415757 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 27/42] 10.222.0.20 () {60 vars in 1155 bytes} [Tue Jul 5 20:54:31 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 21 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 05 20:54:31.428459 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-5f5e5761-c661-4362-88a1-fc850b89d2a0 tempest-VolumesNegativeTest-1885713757 tempest-VolumesNegativeTest-1885713757-project] Calling method '.version_select at 0x7f57d0883a60>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:54:31.547890 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.wsgi [None req-5f5e5761-c661-4362-88a1-fc850b89d2a0 tempest-VolumesNegativeTest-1885713757 tempest-VolumesNegativeTest-1885713757-project] HTTP exception thrown: Volume tempest-invalid-471318556 could not be found. Jul 05 20:54:31.551327 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-5f5e5761-c661-4362-88a1-fc850b89d2a0 tempest-VolumesNegativeTest-1885713757 tempest-VolumesNegativeTest-1885713757-project] Request method failure captured: Jul 05 20:54:31.551327 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-471318556 HTTP/1.1 Jul 05 20:54:31.551327 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: Accept: application/json Jul 05 20:54:31.551327 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: Accept-Encoding: identity Jul 05 20:54:31.551327 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: Connection: close Jul 05 20:54:31.551327 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: Content-Length: 0 Jul 05 20:54:31.551327 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: Content-Type: application/json Jul 05 20:54:31.551327 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: Host: 10.222.0.20 Jul 05 20:54:31.551327 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: Openstack-System-Scope: None Jul 05 20:54:31.551327 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: User-Agent: python-urllib3/1.26.9 Jul 05 20:54:31.551327 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Auth-Token: gAAAAABixKUGZ2uRiR-ceCOIzo3Euoke3CXf8I3aMyJxHNjR-obQtrVV-kJqJGOCWeVrKOLqSTdTOizLunCNrWhUDzLyXXUnWmxRokkcePzsvhrZL6frg7V8c-41PuS0dWDT7qUD2fRLPb7aQPNvIL86ufuRGOib4TF7F5zD9HvYqDH3s_TXX2Y Jul 05 20:54:31.551327 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Domain-Id: None Jul 05 20:54:31.551327 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Domain-Name: None Jul 05 20:54:31.551327 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Identity-Status: Confirmed Jul 05 20:54:31.551327 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Is-Admin-Project: True Jul 05 20:54:31.551327 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Project-Domain-Id: default Jul 05 20:54:31.551327 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Project-Domain-Name: Default Jul 05 20:54:31.551327 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Project-Id: cc1ab9cbfa8a455f8802af5122b3daa0 Jul 05 20:54:31.551327 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Project-Name: tempest-VolumesNegativeTest-1885713757 Jul 05 20:54:31.551327 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Role: member,reader Jul 05 20:54:31.551327 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Roles: member,reader Jul 05 20:54:31.553458 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/cc1ab9cbfa8a455f8802af5122b3daa0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/cc1ab9cbfa8a455f8802af5122b3daa0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_cc1ab9cbfa8a455f8802af5122b3daa0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/cc1ab9cbfa8a455f8802af5122b3daa0"}]}] Jul 05 20:54:31.553458 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Tenant: tempest-VolumesNegativeTest-1885713757 Jul 05 20:54:31.553458 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Tenant-Id: cc1ab9cbfa8a455f8802af5122b3daa0 Jul 05 20:54:31.553458 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Tenant-Name: tempest-VolumesNegativeTest-1885713757 Jul 05 20:54:31.553458 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-User: tempest-VolumesNegativeTest-1885713757-project Jul 05 20:54:31.553458 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-User-Domain-Id: default Jul 05 20:54:31.553458 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-User-Domain-Name: Default Jul 05 20:54:31.553458 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-User-Id: 8d661e8ac05f4e4d8d8cc806d47d8f51 Jul 05 20:54:31.553458 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-User-Name: tempest-VolumesNegativeTest-1885713757-project Jul 05 20:54:31.553458 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: method: Jul 05 20:54:31.553458 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: exception: Volume tempest-invalid-471318556 could not be found. Jul 05 20:54:31.553458 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: action_args: {'id': 'tempest-invalid-471318556'} Jul 05 20:54:31.553458 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 05 20:54:31.555018 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 20:54:31.555018 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 05 20:54:31.555018 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 05 20:54:31.555018 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 05 20:54:31.555018 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 05 20:54:31.555018 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 05 20:54:31.555018 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 05 20:54:31.555018 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 05 20:54:31.555018 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 05 20:54:31.555018 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 05 20:54:31.555018 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 05 20:54:31.555018 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 05 20:54:31.555018 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 05 20:54:31.555018 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 05 20:54:31.555018 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 05 20:54:31.555018 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-471318556 could not be found. (HTTP 404) (Request-ID: req-c35b8e8f-b92e-43f6-b02c-2141ba91e73e) Jul 05 20:54:31.555018 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi Jul 05 20:54:31.555018 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 20:54:31.555018 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi Jul 05 20:54:31.555992 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 20:54:31.555992 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 05 20:54:31.555992 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 05 20:54:31.555992 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 05 20:54:31.555992 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 05 20:54:31.555992 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 05 20:54:31.555992 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 05 20:54:31.555992 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 05 20:54:31.555992 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 05 20:54:31.555992 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 05 20:54:31.555992 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 05 20:54:31.555992 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 05 20:54:31.555992 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 05 20:54:31.555992 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 05 20:54:31.555992 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 05 20:54:31.555992 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 05 20:54:31.555992 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 05 20:54:31.555992 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 05 20:54:31.555992 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 05 20:54:31.557716 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 05 20:54:31.557716 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 05 20:54:31.557716 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 05 20:54:31.557716 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 05 20:54:31.557716 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-471318556 could not be found. Jul 05 20:54:31.557716 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi Jul 05 20:54:31.557716 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 20:54:31.557716 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi Jul 05 20:54:31.557716 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 20:54:31.557716 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 20:54:31.557716 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 20:54:31.557716 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 05 20:54:31.557716 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 05 20:54:31.557716 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 05 20:54:31.557716 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 05 20:54:31.557716 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 05 20:54:31.557716 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 05 20:54:31.557716 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 05 20:54:31.557716 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 05 20:54:31.557716 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-471318556 could not be found. Jul 05 20:54:31.560686 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi Jul 05 20:54:31.560686 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 20:54:31.560686 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi Jul 05 20:54:31.560686 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 20:54:31.560686 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 20:54:31.560686 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 20:54:31.560686 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 05 20:54:31.560686 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 05 20:54:31.560686 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-471318556 could not be found. Jul 05 20:54:31.560686 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi Jul 05 20:54:31.560686 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-5f5e5761-c661-4362-88a1-fc850b89d2a0 tempest-VolumesNegativeTest-1885713757 tempest-VolumesNegativeTest-1885713757-project] Returning 404 to user: Volume tempest-invalid-471318556 could not be found. {{(pid=117627) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 05 20:54:31.560686 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-5f5e5761-c661-4362-88a1-fc850b89d2a0 tempest-VolumesNegativeTest-1885713757 tempest-VolumesNegativeTest-1885713757-project] 10.222.0.20 "DELETE /compute/v2.1/os-volumes/tempest-invalid-471318556" status: 404 len: 98 microversion: 2.1 time: 0.131349 Jul 05 20:54:31.560686 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 16/43] 10.222.0.20 () {58 vars in 1214 bytes} [Tue Jul 5 20:54:31 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-471318556 => generated 98 bytes in 137 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 05 20:54:31.564615 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-d5936b96-39f6-471a-90d4-0c4b6390ec11 tempest-VolumesNegativeTest-1885713757 tempest-VolumesNegativeTest-1885713757-project] 10.222.0.20 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004138 Jul 05 20:54:31.565157 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 28/44] 10.222.0.20 () {58 vars in 1139 bytes} [Tue Jul 5 20:54:31 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 05 20:54:31.585601 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-98a504c5-4881-4c8d-b6e5-bb7b1e9919b7 tempest-VolumesNegativeTest-1885713757 tempest-VolumesNegativeTest-1885713757-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.013959 Jul 05 20:54:31.586381 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 17/45] 10.222.0.20 () {58 vars in 1136 bytes} [Tue Jul 5 20:54:31 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 16 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 05 20:54:31.597754 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-cb6f2c6e-3eb2-4802-b31e-2261b2fafaf7 tempest-VolumesNegativeTest-1885713757 tempest-VolumesNegativeTest-1885713757-project] Calling method '.version_select at 0x7f57cfe2f790>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:54:31.647866 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.wsgi [None req-cb6f2c6e-3eb2-4802-b31e-2261b2fafaf7 tempest-VolumesNegativeTest-1885713757 tempest-VolumesNegativeTest-1885713757-project] HTTP exception thrown: Volume 45d2a27c-442a-4ca2-b8ab-d23a7a4dba95 could not be found. Jul 05 20:54:31.650514 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-cb6f2c6e-3eb2-4802-b31e-2261b2fafaf7 tempest-VolumesNegativeTest-1885713757 tempest-VolumesNegativeTest-1885713757-project] Request method failure captured: Jul 05 20:54:31.650514 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: request: DELETE /compute/v2.1/os-volumes/45d2a27c-442a-4ca2-b8ab-d23a7a4dba95 HTTP/1.1 Jul 05 20:54:31.650514 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: Accept: application/json Jul 05 20:54:31.650514 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: Accept-Encoding: identity Jul 05 20:54:31.650514 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: Connection: close Jul 05 20:54:31.650514 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: Content-Length: 0 Jul 05 20:54:31.650514 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: Content-Type: application/json Jul 05 20:54:31.650514 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: Host: 10.222.0.20 Jul 05 20:54:31.650514 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: Openstack-System-Scope: None Jul 05 20:54:31.650514 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: User-Agent: python-urllib3/1.26.9 Jul 05 20:54:31.650514 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Auth-Token: gAAAAABixKUGZ2uRiR-ceCOIzo3Euoke3CXf8I3aMyJxHNjR-obQtrVV-kJqJGOCWeVrKOLqSTdTOizLunCNrWhUDzLyXXUnWmxRokkcePzsvhrZL6frg7V8c-41PuS0dWDT7qUD2fRLPb7aQPNvIL86ufuRGOib4TF7F5zD9HvYqDH3s_TXX2Y Jul 05 20:54:31.650514 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Domain-Id: None Jul 05 20:54:31.650514 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Domain-Name: None Jul 05 20:54:31.650514 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Identity-Status: Confirmed Jul 05 20:54:31.650514 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Is-Admin-Project: True Jul 05 20:54:31.650514 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Project-Domain-Id: default Jul 05 20:54:31.650514 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Project-Domain-Name: Default Jul 05 20:54:31.650514 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Project-Id: cc1ab9cbfa8a455f8802af5122b3daa0 Jul 05 20:54:31.650514 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Project-Name: tempest-VolumesNegativeTest-1885713757 Jul 05 20:54:31.650514 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Role: member,reader Jul 05 20:54:31.650514 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Roles: member,reader Jul 05 20:54:31.651919 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/cc1ab9cbfa8a455f8802af5122b3daa0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/cc1ab9cbfa8a455f8802af5122b3daa0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_cc1ab9cbfa8a455f8802af5122b3daa0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/cc1ab9cbfa8a455f8802af5122b3daa0"}]}] Jul 05 20:54:31.651919 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Tenant: tempest-VolumesNegativeTest-1885713757 Jul 05 20:54:31.651919 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Tenant-Id: cc1ab9cbfa8a455f8802af5122b3daa0 Jul 05 20:54:31.651919 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Tenant-Name: tempest-VolumesNegativeTest-1885713757 Jul 05 20:54:31.651919 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-User: tempest-VolumesNegativeTest-1885713757-project Jul 05 20:54:31.651919 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-User-Domain-Id: default Jul 05 20:54:31.651919 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-User-Domain-Name: Default Jul 05 20:54:31.651919 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-User-Id: 8d661e8ac05f4e4d8d8cc806d47d8f51 Jul 05 20:54:31.651919 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-User-Name: tempest-VolumesNegativeTest-1885713757-project Jul 05 20:54:31.651919 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: method: Jul 05 20:54:31.651919 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: exception: Volume 45d2a27c-442a-4ca2-b8ab-d23a7a4dba95 could not be found. Jul 05 20:54:31.651919 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: action_args: {'id': '45d2a27c-442a-4ca2-b8ab-d23a7a4dba95'} Jul 05 20:54:31.651919 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 05 20:54:31.652989 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 20:54:31.652989 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 05 20:54:31.652989 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 05 20:54:31.652989 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 05 20:54:31.652989 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 05 20:54:31.652989 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 05 20:54:31.652989 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 05 20:54:31.652989 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 05 20:54:31.652989 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 05 20:54:31.652989 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 05 20:54:31.652989 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 05 20:54:31.652989 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 05 20:54:31.652989 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 05 20:54:31.652989 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 05 20:54:31.652989 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 05 20:54:31.652989 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 45d2a27c-442a-4ca2-b8ab-d23a7a4dba95 could not be found. (HTTP 404) (Request-ID: req-480aa0c5-8ccb-4794-b78c-10c01d349f13) Jul 05 20:54:31.652989 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi Jul 05 20:54:31.652989 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 20:54:31.652989 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi Jul 05 20:54:31.654002 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 20:54:31.654002 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 05 20:54:31.654002 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 05 20:54:31.654002 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 05 20:54:31.654002 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 05 20:54:31.654002 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 05 20:54:31.654002 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 05 20:54:31.654002 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 05 20:54:31.654002 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 05 20:54:31.654002 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 05 20:54:31.654002 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 05 20:54:31.654002 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 05 20:54:31.654002 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 05 20:54:31.654002 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 05 20:54:31.654002 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 05 20:54:31.654002 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 05 20:54:31.654002 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 05 20:54:31.654002 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 05 20:54:31.654002 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 05 20:54:31.656390 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 05 20:54:31.656390 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 05 20:54:31.656390 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 05 20:54:31.656390 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 05 20:54:31.656390 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 45d2a27c-442a-4ca2-b8ab-d23a7a4dba95 could not be found. Jul 05 20:54:31.656390 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi Jul 05 20:54:31.656390 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 20:54:31.656390 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi Jul 05 20:54:31.656390 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 20:54:31.656390 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 20:54:31.656390 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 20:54:31.656390 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 05 20:54:31.656390 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 05 20:54:31.656390 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 05 20:54:31.656390 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 05 20:54:31.656390 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 05 20:54:31.656390 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 05 20:54:31.656390 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 05 20:54:31.656390 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 05 20:54:31.657369 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 45d2a27c-442a-4ca2-b8ab-d23a7a4dba95 could not be found. Jul 05 20:54:31.657369 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi Jul 05 20:54:31.657369 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 20:54:31.657369 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi Jul 05 20:54:31.657369 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 20:54:31.657369 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 20:54:31.657369 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 20:54:31.657369 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 05 20:54:31.657369 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 05 20:54:31.657369 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 45d2a27c-442a-4ca2-b8ab-d23a7a4dba95 could not be found. Jul 05 20:54:31.657369 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi Jul 05 20:54:31.657369 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-cb6f2c6e-3eb2-4802-b31e-2261b2fafaf7 tempest-VolumesNegativeTest-1885713757 tempest-VolumesNegativeTest-1885713757-project] Returning 404 to user: Volume 45d2a27c-442a-4ca2-b8ab-d23a7a4dba95 could not be found. {{(pid=117628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 05 20:54:31.657369 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-cb6f2c6e-3eb2-4802-b31e-2261b2fafaf7 tempest-VolumesNegativeTest-1885713757 tempest-VolumesNegativeTest-1885713757-project] 10.222.0.20 "DELETE /compute/v2.1/os-volumes/45d2a27c-442a-4ca2-b8ab-d23a7a4dba95" status: 404 len: 109 microversion: 2.1 time: 0.060189 Jul 05 20:54:31.657369 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 29/46] 10.222.0.20 () {58 vars in 1247 bytes} [Tue Jul 5 20:54:31 2022] DELETE /compute/v2.1/os-volumes/45d2a27c-442a-4ca2-b8ab-d23a7a4dba95 => generated 109 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 05 20:54:31.664533 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-ef5e2edd-bc6e-4e29-a505-013b13b27fac tempest-VolumesNegativeTest-1885713757 tempest-VolumesNegativeTest-1885713757-project] Calling method '.version_select at 0x7f57cec4b160>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:54:31.719143 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.wsgi [None req-ef5e2edd-bc6e-4e29-a505-013b13b27fac tempest-VolumesNegativeTest-1885713757 tempest-VolumesNegativeTest-1885713757-project] HTTP exception thrown: Volume 834c483c-f111-4067-b2d8-5472017e098f could not be found. Jul 05 20:54:31.724460 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-ef5e2edd-bc6e-4e29-a505-013b13b27fac tempest-VolumesNegativeTest-1885713757 tempest-VolumesNegativeTest-1885713757-project] Request method failure captured: Jul 05 20:54:31.724460 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: request: GET /compute/v2.1/os-volumes/834c483c-f111-4067-b2d8-5472017e098f HTTP/1.1 Jul 05 20:54:31.724460 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: Accept: application/json Jul 05 20:54:31.724460 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: Accept-Encoding: identity Jul 05 20:54:31.724460 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: Connection: close Jul 05 20:54:31.724460 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: Content-Length: 0 Jul 05 20:54:31.724460 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: Content-Type: application/json Jul 05 20:54:31.724460 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: Host: 10.222.0.20 Jul 05 20:54:31.724460 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: Openstack-System-Scope: None Jul 05 20:54:31.724460 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: User-Agent: python-urllib3/1.26.9 Jul 05 20:54:31.724460 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Auth-Token: gAAAAABixKUGZ2uRiR-ceCOIzo3Euoke3CXf8I3aMyJxHNjR-obQtrVV-kJqJGOCWeVrKOLqSTdTOizLunCNrWhUDzLyXXUnWmxRokkcePzsvhrZL6frg7V8c-41PuS0dWDT7qUD2fRLPb7aQPNvIL86ufuRGOib4TF7F5zD9HvYqDH3s_TXX2Y Jul 05 20:54:31.724460 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Domain-Id: None Jul 05 20:54:31.724460 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Domain-Name: None Jul 05 20:54:31.724460 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Identity-Status: Confirmed Jul 05 20:54:31.724460 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Is-Admin-Project: True Jul 05 20:54:31.724460 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Project-Domain-Id: default Jul 05 20:54:31.724460 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Project-Domain-Name: Default Jul 05 20:54:31.724460 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Project-Id: cc1ab9cbfa8a455f8802af5122b3daa0 Jul 05 20:54:31.724460 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Project-Name: tempest-VolumesNegativeTest-1885713757 Jul 05 20:54:31.724460 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Role: member,reader Jul 05 20:54:31.724460 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Roles: member,reader Jul 05 20:54:31.725927 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/cc1ab9cbfa8a455f8802af5122b3daa0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/cc1ab9cbfa8a455f8802af5122b3daa0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_cc1ab9cbfa8a455f8802af5122b3daa0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/cc1ab9cbfa8a455f8802af5122b3daa0"}]}] Jul 05 20:54:31.725927 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Tenant: tempest-VolumesNegativeTest-1885713757 Jul 05 20:54:31.725927 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Tenant-Id: cc1ab9cbfa8a455f8802af5122b3daa0 Jul 05 20:54:31.725927 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Tenant-Name: tempest-VolumesNegativeTest-1885713757 Jul 05 20:54:31.725927 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-User: tempest-VolumesNegativeTest-1885713757-project Jul 05 20:54:31.725927 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-User-Domain-Id: default Jul 05 20:54:31.725927 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-User-Domain-Name: Default Jul 05 20:54:31.725927 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-User-Id: 8d661e8ac05f4e4d8d8cc806d47d8f51 Jul 05 20:54:31.725927 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-User-Name: tempest-VolumesNegativeTest-1885713757-project Jul 05 20:54:31.725927 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: method: Jul 05 20:54:31.725927 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: exception: Volume 834c483c-f111-4067-b2d8-5472017e098f could not be found. Jul 05 20:54:31.725927 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: action_args: {'id': '834c483c-f111-4067-b2d8-5472017e098f'} Jul 05 20:54:31.725927 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 05 20:54:31.726769 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 20:54:31.726769 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 05 20:54:31.726769 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 05 20:54:31.726769 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 05 20:54:31.726769 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 05 20:54:31.726769 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 05 20:54:31.726769 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 05 20:54:31.726769 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 05 20:54:31.726769 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 05 20:54:31.726769 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 05 20:54:31.726769 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 05 20:54:31.726769 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 05 20:54:31.726769 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 05 20:54:31.726769 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 05 20:54:31.726769 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 05 20:54:31.726769 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 834c483c-f111-4067-b2d8-5472017e098f could not be found. (HTTP 404) (Request-ID: req-2879d609-2e18-467d-94a4-ed85d5c0c563) Jul 05 20:54:31.726769 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi Jul 05 20:54:31.726769 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 20:54:31.726769 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi Jul 05 20:54:31.727773 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 20:54:31.727773 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 05 20:54:31.727773 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 05 20:54:31.727773 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 05 20:54:31.727773 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 05 20:54:31.727773 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 05 20:54:31.727773 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 05 20:54:31.727773 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 05 20:54:31.727773 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 05 20:54:31.727773 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 05 20:54:31.727773 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 05 20:54:31.727773 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 05 20:54:31.727773 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 05 20:54:31.727773 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 05 20:54:31.727773 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 05 20:54:31.727773 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 05 20:54:31.727773 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 05 20:54:31.727773 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 05 20:54:31.727773 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 05 20:54:31.728686 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 05 20:54:31.728686 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 05 20:54:31.728686 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 05 20:54:31.728686 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 05 20:54:31.728686 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 834c483c-f111-4067-b2d8-5472017e098f could not be found. Jul 05 20:54:31.728686 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi Jul 05 20:54:31.728686 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 20:54:31.728686 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi Jul 05 20:54:31.728686 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 20:54:31.728686 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 20:54:31.728686 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 20:54:31.728686 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 05 20:54:31.728686 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 05 20:54:31.728686 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 05 20:54:31.728686 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 05 20:54:31.728686 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 05 20:54:31.728686 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 05 20:54:31.728686 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 05 20:54:31.728686 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 05 20:54:31.729690 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 834c483c-f111-4067-b2d8-5472017e098f could not be found. Jul 05 20:54:31.729690 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi Jul 05 20:54:31.729690 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 20:54:31.729690 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi Jul 05 20:54:31.729690 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 20:54:31.729690 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 20:54:31.729690 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 20:54:31.729690 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 05 20:54:31.729690 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 05 20:54:31.729690 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 834c483c-f111-4067-b2d8-5472017e098f could not be found. Jul 05 20:54:31.729690 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi Jul 05 20:54:31.729690 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-ef5e2edd-bc6e-4e29-a505-013b13b27fac tempest-VolumesNegativeTest-1885713757 tempest-VolumesNegativeTest-1885713757-project] Returning 404 to user: Volume 834c483c-f111-4067-b2d8-5472017e098f could not be found. {{(pid=117627) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 05 20:54:31.729690 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-ef5e2edd-bc6e-4e29-a505-013b13b27fac tempest-VolumesNegativeTest-1885713757 tempest-VolumesNegativeTest-1885713757-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/834c483c-f111-4067-b2d8-5472017e098f" status: 404 len: 109 microversion: 2.1 time: 0.068898 Jul 05 20:54:31.738315 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 18/47] 10.222.0.20 () {58 vars in 1244 bytes} [Tue Jul 5 20:54:31 2022] GET /compute/v2.1/os-volumes/834c483c-f111-4067-b2d8-5472017e098f => generated 109 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 05 20:54:31.840047 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-411735c3-0a98-4d10-84c2-a590ae0b84f6 tempest-DeleteServersTestJSON-389510094 tempest-DeleteServersTestJSON-389510094-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:54:31.840656 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-411735c3-0a98-4d10-84c2-a590ae0b84f6 tempest-DeleteServersTestJSON-389510094 tempest-DeleteServersTestJSON-389510094-project] [instance: 1159954e-7c69-48d8-b051-5a7b1108da69] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:54:31.860454 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-411735c3-0a98-4d10-84c2-a590ae0b84f6 tempest-DeleteServersTestJSON-389510094 tempest-DeleteServersTestJSON-389510094-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:54:31.863313 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-411735c3-0a98-4d10-84c2-a590ae0b84f6 tempest-DeleteServersTestJSON-389510094 tempest-DeleteServersTestJSON-389510094-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:54:31.869933 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-411735c3-0a98-4d10-84c2-a590ae0b84f6 tempest-DeleteServersTestJSON-389510094 tempest-DeleteServersTestJSON-389510094-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:54:31.870381 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-411735c3-0a98-4d10-84c2-a590ae0b84f6 tempest-DeleteServersTestJSON-389510094 tempest-DeleteServersTestJSON-389510094-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:54:32.389661 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-7f8003ed-40b1-453b-a31d-cd5b3e180bda tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Action: 'create', calling method: .version_select at 0x7f57cfdeeb80>, body: {"keypair": {"name": "tempest-keypair-1081690412", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKWO2atkusQYiOMly0iIN0uvM77Li5tu7KuAGQVdRTXB0fI37AI1JcHHINDqnrbQhO4RyoXuDzcs0cOjn+kML1byBD3tZo22LoYuDNMRhHWXY4okyLLrFtp0IEBJo6Q/WA=="}} {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 20:54:32.555820 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.quota [None req-7f8003ed-40b1-453b-a31d-cd5b3e180bda tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Getting quotas for project c47e1ad014d542f98f6b24c8a504d166. Resources: {'key_pairs'} {{(pid=117628) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 05 20:54:32.599190 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.quota [None req-7f8003ed-40b1-453b-a31d-cd5b3e180bda tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Getting quotas for user 5eac41ce3f04450b840cff305ec1a5ac and project c47e1ad014d542f98f6b24c8a504d166. Resources: {'key_pairs'} {{(pid=117628) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 05 20:54:32.788051 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-7f8003ed-40b1-453b-a31d-cd5b3e180bda tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 1.068665 Jul 05 20:54:32.790138 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 30/48] 10.222.0.20 () {60 vars in 1158 bytes} [Tue Jul 5 20:54:31 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 1073 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 20:54:32.987887 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-411735c3-0a98-4d10-84c2-a590ae0b84f6 tempest-DeleteServersTestJSON-389510094 tempest-DeleteServersTestJSON-389510094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5063db22225a4d0b97ec5dcac8770045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '873a5ea6741e4762857e2bae05f5e06d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:54:33.008410 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-411735c3-0a98-4d10-84c2-a590ae0b84f6 tempest-DeleteServersTestJSON-389510094 tempest-DeleteServersTestJSON-389510094-project] 10.222.0.20 "GET /compute/v2.1/servers/1159954e-7c69-48d8-b051-5a7b1108da69" status: 200 len: 1273 microversion: 2.1 time: 1.171346 Jul 05 20:54:33.009045 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 19/49] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:54:31 2022] GET /compute/v2.1/servers/1159954e-7c69-48d8-b051-5a7b1108da69 => generated 1273 bytes in 1174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 20:54:34.027863 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-1366e396-fd3e-45cd-832c-fd4cfa916ddc tempest-DeleteServersTestJSON-389510094 tempest-DeleteServersTestJSON-389510094-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:54:34.028656 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-1366e396-fd3e-45cd-832c-fd4cfa916ddc tempest-DeleteServersTestJSON-389510094 tempest-DeleteServersTestJSON-389510094-project] [instance: 1159954e-7c69-48d8-b051-5a7b1108da69] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:54:34.042380 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-1366e396-fd3e-45cd-832c-fd4cfa916ddc tempest-DeleteServersTestJSON-389510094 tempest-DeleteServersTestJSON-389510094-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:54:34.047976 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-1366e396-fd3e-45cd-832c-fd4cfa916ddc tempest-DeleteServersTestJSON-389510094 tempest-DeleteServersTestJSON-389510094-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:54:34.049655 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-1366e396-fd3e-45cd-832c-fd4cfa916ddc tempest-DeleteServersTestJSON-389510094 tempest-DeleteServersTestJSON-389510094-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:54:34.051322 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-1366e396-fd3e-45cd-832c-fd4cfa916ddc tempest-DeleteServersTestJSON-389510094 tempest-DeleteServersTestJSON-389510094-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:54:34.687826 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-1366e396-fd3e-45cd-832c-fd4cfa916ddc tempest-DeleteServersTestJSON-389510094 tempest-DeleteServersTestJSON-389510094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5063db22225a4d0b97ec5dcac8770045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '873a5ea6741e4762857e2bae05f5e06d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:54:34.735367 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-1366e396-fd3e-45cd-832c-fd4cfa916ddc tempest-DeleteServersTestJSON-389510094 tempest-DeleteServersTestJSON-389510094-project] 10.222.0.20 "GET /compute/v2.1/servers/1159954e-7c69-48d8-b051-5a7b1108da69" status: 200 len: 1273 microversion: 2.1 time: 0.713048 Jul 05 20:54:34.755805 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 31/50] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:54:34 2022] GET /compute/v2.1/servers/1159954e-7c69-48d8-b051-5a7b1108da69 => generated 1273 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 20:54:35.774848 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-012d4078-a632-4bf5-b196-d8cd0e473003 tempest-DeleteServersTestJSON-389510094 tempest-DeleteServersTestJSON-389510094-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:54:35.776066 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-012d4078-a632-4bf5-b196-d8cd0e473003 tempest-DeleteServersTestJSON-389510094 tempest-DeleteServersTestJSON-389510094-project] [instance: 1159954e-7c69-48d8-b051-5a7b1108da69] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:54:35.807963 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-012d4078-a632-4bf5-b196-d8cd0e473003 tempest-DeleteServersTestJSON-389510094 tempest-DeleteServersTestJSON-389510094-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:54:35.810877 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-012d4078-a632-4bf5-b196-d8cd0e473003 tempest-DeleteServersTestJSON-389510094 tempest-DeleteServersTestJSON-389510094-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:54:35.812229 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-012d4078-a632-4bf5-b196-d8cd0e473003 tempest-DeleteServersTestJSON-389510094 tempest-DeleteServersTestJSON-389510094-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:54:35.826654 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-012d4078-a632-4bf5-b196-d8cd0e473003 tempest-DeleteServersTestJSON-389510094 tempest-DeleteServersTestJSON-389510094-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:54:36.298861 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG dbcounter [-] [117627] Writing DB stats nova_cell0:SELECT=2 {{(pid=117627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:54:37.135908 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG dbcounter [-] [117627] Writing DB stats nova_cell0:SELECT=8 {{(pid=117627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:54:37.451291 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-012d4078-a632-4bf5-b196-d8cd0e473003 tempest-DeleteServersTestJSON-389510094 tempest-DeleteServersTestJSON-389510094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5063db22225a4d0b97ec5dcac8770045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '873a5ea6741e4762857e2bae05f5e06d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:54:37.488376 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-012d4078-a632-4bf5-b196-d8cd0e473003 tempest-DeleteServersTestJSON-389510094 tempest-DeleteServersTestJSON-389510094-project] 10.222.0.20 "GET /compute/v2.1/servers/1159954e-7c69-48d8-b051-5a7b1108da69" status: 200 len: 1315 microversion: 2.1 time: 1.719276 Jul 05 20:54:37.489349 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 20/51] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:54:35 2022] GET /compute/v2.1/servers/1159954e-7c69-48d8-b051-5a7b1108da69 => generated 1315 bytes in 1723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 20:54:38.431891 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-3dc1b3c4-438a-4764-9dbb-75bfbe155456 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1670206936", "imageRef": "88e08f49-c01d-4849-a89f-b678588e56f4", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e8141f6d-89df-4417-ae89-c8d06b44cee8"}], "security_groups": [{"name": "tempest-securitygroup--529561810"}], "key_name": "tempest-keypair-1081690412", "user_data": "}} {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 20:54:38.506564 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-6c002e81-7ffa-4825-a0ac-5f82c82870d1 tempest-DeleteServersTestJSON-389510094 tempest-DeleteServersTestJSON-389510094-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:54:38.507190 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-6c002e81-7ffa-4825-a0ac-5f82c82870d1 tempest-DeleteServersTestJSON-389510094 tempest-DeleteServersTestJSON-389510094-project] [instance: 1159954e-7c69-48d8-b051-5a7b1108da69] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:54:38.527119 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-6c002e81-7ffa-4825-a0ac-5f82c82870d1 tempest-DeleteServersTestJSON-389510094 tempest-DeleteServersTestJSON-389510094-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:54:38.527829 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-6c002e81-7ffa-4825-a0ac-5f82c82870d1 tempest-DeleteServersTestJSON-389510094 tempest-DeleteServersTestJSON-389510094-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:54:38.528606 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-6c002e81-7ffa-4825-a0ac-5f82c82870d1 tempest-DeleteServersTestJSON-389510094 tempest-DeleteServersTestJSON-389510094-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:54:38.539900 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-6c002e81-7ffa-4825-a0ac-5f82c82870d1 tempest-DeleteServersTestJSON-389510094 tempest-DeleteServersTestJSON-389510094-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:54:39.879154 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.network.neutron [None req-3dc1b3c4-438a-4764-9dbb-75bfbe155456 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] validate_networks() for [('e8141f6d-89df-4417-ae89-c8d06b44cee8', None, None, None, None, None)] {{(pid=117628) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 05 20:54:40.764518 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-6c002e81-7ffa-4825-a0ac-5f82c82870d1 tempest-DeleteServersTestJSON-389510094 tempest-DeleteServersTestJSON-389510094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5063db22225a4d0b97ec5dcac8770045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '873a5ea6741e4762857e2bae05f5e06d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:54:40.770872 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-6c002e81-7ffa-4825-a0ac-5f82c82870d1 tempest-DeleteServersTestJSON-389510094 tempest-DeleteServersTestJSON-389510094-project] 10.222.0.20 "GET /compute/v2.1/servers/1159954e-7c69-48d8-b051-5a7b1108da69" status: 200 len: 1315 microversion: 2.1 time: 2.268911 Jul 05 20:54:40.786319 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 21/52] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:54:38 2022] GET /compute/v2.1/servers/1159954e-7c69-48d8-b051-5a7b1108da69 => generated 1315 bytes in 2270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 20:54:41.362116 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-ecebbe53-8239-4232-b93b-36cf136e713a tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1861887628", "imageRef": "88e08f49-c01d-4849-a89f-b678588e56f4", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 20:54:41.561827 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.network.neutron [None req-ecebbe53-8239-4232-b93b-36cf136e713a tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] validate_networks() for [('b7580cfc-ddfa-4e5a-84ac-e60422771b4c', None, None, None, None, None)] {{(pid=117627) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 05 20:54:42.653854 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG dbcounter [-] [117628] Writing DB stats nova_cell0:SELECT=6 {{(pid=117628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:54:44.715085 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG dbcounter [-] [117628] Writing DB stats nova_cell1:SELECT=6 {{(pid=117628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:54:45.813897 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.virt.hardware [None req-3dc1b3c4-438a-4764-9dbb-75bfbe155456 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Flavor limits 0:0:0 {{(pid=117628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 05 20:54:45.815163 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.virt.hardware [None req-3dc1b3c4-438a-4764-9dbb-75bfbe155456 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Image limits 0:0:0 {{(pid=117628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 05 20:54:45.815866 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.virt.hardware [None req-3dc1b3c4-438a-4764-9dbb-75bfbe155456 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Flavor pref 0:0:0 {{(pid=117628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 05 20:54:45.816532 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.virt.hardware [None req-3dc1b3c4-438a-4764-9dbb-75bfbe155456 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Image pref 0:0:0 {{(pid=117628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 05 20:54:45.817708 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.virt.hardware [None req-3dc1b3c4-438a-4764-9dbb-75bfbe155456 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 05 20:54:45.877267 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-3dc1b3c4-438a-4764-9dbb-75bfbe155456 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:54:45.881576 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-3dc1b3c4-438a-4764-9dbb-75bfbe155456 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:54:45.883812 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-3dc1b3c4-438a-4764-9dbb-75bfbe155456 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:54:45.900022 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-3dc1b3c4-438a-4764-9dbb-75bfbe155456 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:54:45.906964 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.virt.hardware [None req-ecebbe53-8239-4232-b93b-36cf136e713a tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Flavor limits 0:0:0 {{(pid=117627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 05 20:54:45.907840 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.virt.hardware [None req-ecebbe53-8239-4232-b93b-36cf136e713a tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Image limits 0:0:0 {{(pid=117627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 05 20:54:45.908396 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.virt.hardware [None req-ecebbe53-8239-4232-b93b-36cf136e713a tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Flavor pref 0:0:0 {{(pid=117627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 05 20:54:45.908919 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.virt.hardware [None req-ecebbe53-8239-4232-b93b-36cf136e713a tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Image pref 0:0:0 {{(pid=117627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 05 20:54:45.909487 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.virt.hardware [None req-ecebbe53-8239-4232-b93b-36cf136e713a tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 05 20:54:45.924747 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG dbcounter [-] [117627] Writing DB stats nova_api:SELECT=28,nova_api:INSERT=3 {{(pid=117627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:54:45.963954 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-ecebbe53-8239-4232-b93b-36cf136e713a tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:54:45.969655 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-ecebbe53-8239-4232-b93b-36cf136e713a tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:54:45.970869 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-ecebbe53-8239-4232-b93b-36cf136e713a tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:54:45.973213 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-ecebbe53-8239-4232-b93b-36cf136e713a tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:54:46.009710 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.quota [None req-3dc1b3c4-438a-4764-9dbb-75bfbe155456 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Getting quotas for project c47e1ad014d542f98f6b24c8a504d166. Resources: {'cores', 'ram', 'instances'} {{(pid=117628) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 05 20:54:46.016269 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.quota [None req-3dc1b3c4-438a-4764-9dbb-75bfbe155456 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Getting quotas for user 5eac41ce3f04450b840cff305ec1a5ac and project c47e1ad014d542f98f6b24c8a504d166. Resources: {'cores', 'ram', 'instances'} {{(pid=117628) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 05 20:54:46.039512 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-3dc1b3c4-438a-4764-9dbb-75bfbe155456 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Going to run 1 instances... {{(pid=117628) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 05 20:54:46.046537 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-3dc1b3c4-438a-4764-9dbb-75bfbe155456 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] [instance: f236112c-4649-478b-a626-b84f8ff1bfe9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='88e08f49-c01d-4849-a89f-b678588e56f4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117628) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 05 20:54:46.046908 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.quota [None req-ecebbe53-8239-4232-b93b-36cf136e713a tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Getting quotas for project fc6d47f96d17471d94367bc8f8a3e3f6. Resources: {'cores', 'ram', 'instances'} {{(pid=117627) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 05 20:54:46.057994 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.quota [None req-ecebbe53-8239-4232-b93b-36cf136e713a tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Getting quotas for user d152763a64794301b21587ab2b395bbf and project fc6d47f96d17471d94367bc8f8a3e3f6. Resources: {'cores', 'ram', 'instances'} {{(pid=117627) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 05 20:54:46.091857 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-ecebbe53-8239-4232-b93b-36cf136e713a tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Going to run 1 instances... {{(pid=117627) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 05 20:54:46.097414 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-ecebbe53-8239-4232-b93b-36cf136e713a tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] [instance: a3aeae5c-d73d-4fb3-afa0-ee691e6a4fd4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='88e08f49-c01d-4849-a89f-b678588e56f4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117627) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 05 20:54:46.179314 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-ecebbe53-8239-4232-b93b-36cf136e713a tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 5.406450 Jul 05 20:54:46.180146 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 22/53] 10.222.0.20 () {60 vars in 1146 bytes} [Tue Jul 5 20:54:40 2022] POST /compute/v2.1/servers => generated 383 bytes in 5408 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 05 20:54:46.184953 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-816217ac-bf8d-4e2d-af84-e298da189f97 tempest-DeleteServersTestJSON-389510094 tempest-DeleteServersTestJSON-389510094-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:54:46.185914 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-816217ac-bf8d-4e2d-af84-e298da189f97 tempest-DeleteServersTestJSON-389510094 tempest-DeleteServersTestJSON-389510094-project] [instance: 1159954e-7c69-48d8-b051-5a7b1108da69] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:54:46.199346 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-816217ac-bf8d-4e2d-af84-e298da189f97 tempest-DeleteServersTestJSON-389510094 tempest-DeleteServersTestJSON-389510094-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:54:46.200748 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-816217ac-bf8d-4e2d-af84-e298da189f97 tempest-DeleteServersTestJSON-389510094 tempest-DeleteServersTestJSON-389510094-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:54:46.201814 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-816217ac-bf8d-4e2d-af84-e298da189f97 tempest-DeleteServersTestJSON-389510094 tempest-DeleteServersTestJSON-389510094-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:54:46.202457 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-816217ac-bf8d-4e2d-af84-e298da189f97 tempest-DeleteServersTestJSON-389510094 tempest-DeleteServersTestJSON-389510094-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:54:46.223683 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-3dc1b3c4-438a-4764-9dbb-75bfbe155456 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 7.796947 Jul 05 20:54:46.224347 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 32/54] 10.222.0.20 () {60 vars in 1146 bytes} [Tue Jul 5 20:54:38 2022] POST /compute/v2.1/servers => generated 401 bytes in 7799 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 05 20:54:46.573937 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-816217ac-bf8d-4e2d-af84-e298da189f97 tempest-DeleteServersTestJSON-389510094 tempest-DeleteServersTestJSON-389510094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5063db22225a4d0b97ec5dcac8770045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '873a5ea6741e4762857e2bae05f5e06d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:54:46.588541 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-816217ac-bf8d-4e2d-af84-e298da189f97 tempest-DeleteServersTestJSON-389510094 tempest-DeleteServersTestJSON-389510094-project] 10.222.0.20 "GET /compute/v2.1/servers/1159954e-7c69-48d8-b051-5a7b1108da69" status: 200 len: 1315 microversion: 2.1 time: 0.407109 Jul 05 20:54:46.598677 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 23/55] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:54:46 2022] GET /compute/v2.1/servers/1159954e-7c69-48d8-b051-5a7b1108da69 => generated 1315 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 20:54:46.868092 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [req-dbf6a5e2-0ee7-4800-9b16-6da593108287 req-4942454f-ab11-4102-86b5-18c4bb48d24e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1159954e-7c69-48d8-b051-5a7b1108da69", "tag": "c23f1cb7-7c8c-45f8-b9aa-1642f642532e"}]} {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 20:54:46.893759 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [req-dbf6a5e2-0ee7-4800-9b16-6da593108287 req-4942454f-ab11-4102-86b5-18c4bb48d24e service nova] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:54:46.896563 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [req-dbf6a5e2-0ee7-4800-9b16-6da593108287 req-4942454f-ab11-4102-86b5-18c4bb48d24e service nova] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:54:46.960057 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-e0dec379-1196-4ddb-91e8-858997da8126 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Action: 'create', calling method: .version_select at 0x7f57cf3ca8b0>, body: {"keypair": {"name": "tempest-keypair-659881", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAfOoePrZmg5YmnBzCNdbrPHe8iiwcZ41gcH4fXYw3r7IaRtSUlDDpZbv+LuiKBqoBGs7zTN7DRa6UtoWAOyTgLGQRTMch9X9x8YJIRuGdGVmPfRv/AqZ91Ke0QCq/VdSg=="}} {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 20:54:46.981318 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.compute.server_external_events [req-dbf6a5e2-0ee7-4800-9b16-6da593108287 req-4942454f-ab11-4102-86b5-18c4bb48d24e service nova] Creating event network-changed:c23f1cb7-7c8c-45f8-b9aa-1642f642532e for instance 1159954e-7c69-48d8-b051-5a7b1108da69 on hv-cinder-79760 Jul 05 20:54:46.984467 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [req-dbf6a5e2-0ee7-4800-9b16-6da593108287 req-4942454f-ab11-4102-86b5-18c4bb48d24e service nova] Acquired lock "compute-rpcapi-router" {{(pid=117627) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 05 20:54:47.001329 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-13c330f0-824b-4798-820a-bed57bbe6b0e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:54:47.008419 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-13c330f0-824b-4798-820a-bed57bbe6b0e None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:54:47.018413 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.quota [None req-e0dec379-1196-4ddb-91e8-858997da8126 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Getting quotas for project 9c5fb5bc86604f38b5f0f3a46525189a. Resources: {'key_pairs'} {{(pid=117628) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 05 20:54:47.018951 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-13c330f0-824b-4798-820a-bed57bbe6b0e None None] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:54:47.019583 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-13c330f0-824b-4798-820a-bed57bbe6b0e None None] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:54:47.034963 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.quota [None req-e0dec379-1196-4ddb-91e8-858997da8126 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Getting quotas for user a3792881ae73408db651dd6eb09b3d25 and project 9c5fb5bc86604f38b5f0f3a46525189a. Resources: {'key_pairs'} {{(pid=117628) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 05 20:54:47.056529 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.compute.rpcapi [None req-13c330f0-824b-4798-820a-bed57bbe6b0e None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 05 20:54:47.057487 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-13c330f0-824b-4798-820a-bed57bbe6b0e None None] Releasing lock "compute-rpcapi-router" {{(pid=117627) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 05 20:54:47.115849 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-13c330f0-824b-4798-820a-bed57bbe6b0e None None] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.515353 Jul 05 20:54:47.119366 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 24/56] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 5 20:54:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 20:54:47.131420 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-e0dec379-1196-4ddb-91e8-858997da8126 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 201 len: 397 microversion: 2.20 time: 0.899901 Jul 05 20:54:47.144096 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 33/57] 10.222.0.20 () {62 vars in 1199 bytes} [Tue Jul 5 20:54:46 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 919 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 05 20:54:47.161329 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-195d5029-bb86-4c61-81dd-65735c5f8daf tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:54:47.161734 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-ccc2ee8b-233e-4085-986e-2aa5b043b1d9 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:54:47.172746 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-ccc2ee8b-233e-4085-986e-2aa5b043b1d9 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] [instance: a3aeae5c-d73d-4fb3-afa0-ee691e6a4fd4] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:54:47.179397 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-195d5029-bb86-4c61-81dd-65735c5f8daf tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] [instance: f236112c-4649-478b-a626-b84f8ff1bfe9] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:54:47.491081 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-ccc2ee8b-233e-4085-986e-2aa5b043b1d9 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd152763a64794301b21587ab2b395bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc6d47f96d17471d94367bc8f8a3e3f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:54:47.503254 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-ccc2ee8b-233e-4085-986e-2aa5b043b1d9 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] 10.222.0.20 "GET /compute/v2.1/servers/a3aeae5c-d73d-4fb3-afa0-ee691e6a4fd4" status: 200 len: 1222 microversion: 2.1 time: 0.382185 Jul 05 20:54:47.510969 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 25/58] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:54:47 2022] GET /compute/v2.1/servers/a3aeae5c-d73d-4fb3-afa0-ee691e6a4fd4 => generated 1222 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 20:54:47.583665 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-195d5029-bb86-4c61-81dd-65735c5f8daf tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eac41ce3f04450b840cff305ec1a5ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47e1ad014d542f98f6b24c8a504d166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:54:47.605419 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-283420be-5313-454f-af44-3dbf27d51a63 tempest-DeleteServersTestJSON-389510094 tempest-DeleteServersTestJSON-389510094-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:54:47.606562 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-283420be-5313-454f-af44-3dbf27d51a63 tempest-DeleteServersTestJSON-389510094 tempest-DeleteServersTestJSON-389510094-project] [instance: 1159954e-7c69-48d8-b051-5a7b1108da69] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:54:47.618806 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-195d5029-bb86-4c61-81dd-65735c5f8daf tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] 10.222.0.20 "GET /compute/v2.1/servers/f236112c-4649-478b-a626-b84f8ff1bfe9" status: 200 len: 1238 microversion: 2.1 time: 0.449713 Jul 05 20:54:47.621439 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 34/59] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:54:47 2022] GET /compute/v2.1/servers/f236112c-4649-478b-a626-b84f8ff1bfe9 => generated 1238 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 20:54:47.654460 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-283420be-5313-454f-af44-3dbf27d51a63 tempest-DeleteServersTestJSON-389510094 tempest-DeleteServersTestJSON-389510094-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:54:47.655217 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-283420be-5313-454f-af44-3dbf27d51a63 tempest-DeleteServersTestJSON-389510094 tempest-DeleteServersTestJSON-389510094-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.034s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:54:47.666049 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-283420be-5313-454f-af44-3dbf27d51a63 tempest-DeleteServersTestJSON-389510094 tempest-DeleteServersTestJSON-389510094-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:54:47.669146 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-283420be-5313-454f-af44-3dbf27d51a63 tempest-DeleteServersTestJSON-389510094 tempest-DeleteServersTestJSON-389510094-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:54:47.869140 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-b31cefe1-cc52-4058-87d2-69bbd02674ed tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-740382341", "imageRef": "88e08f49-c01d-4849-a89f-b678588e56f4", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 20:54:48.053258 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.network.neutron [None req-b31cefe1-cc52-4058-87d2-69bbd02674ed tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] validate_networks() for [('b7580cfc-ddfa-4e5a-84ac-e60422771b4c', None, None, None, None, None)] {{(pid=117628) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 05 20:54:48.080378 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-283420be-5313-454f-af44-3dbf27d51a63 tempest-DeleteServersTestJSON-389510094 tempest-DeleteServersTestJSON-389510094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5063db22225a4d0b97ec5dcac8770045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '873a5ea6741e4762857e2bae05f5e06d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:54:48.095823 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-283420be-5313-454f-af44-3dbf27d51a63 tempest-DeleteServersTestJSON-389510094 tempest-DeleteServersTestJSON-389510094-project] 10.222.0.20 "GET /compute/v2.1/servers/1159954e-7c69-48d8-b051-5a7b1108da69" status: 200 len: 1315 microversion: 2.1 time: 0.491449 Jul 05 20:54:48.110429 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 26/60] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:54:47 2022] GET /compute/v2.1/servers/1159954e-7c69-48d8-b051-5a7b1108da69 => generated 1315 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 20:54:48.642133 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-6f21b20b-03ae-4a8c-9635-bccc479731a7 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:54:48.642947 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-6f21b20b-03ae-4a8c-9635-bccc479731a7 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] [instance: f236112c-4649-478b-a626-b84f8ff1bfe9] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:54:48.662807 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-6f21b20b-03ae-4a8c-9635-bccc479731a7 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:54:48.663268 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-6f21b20b-03ae-4a8c-9635-bccc479731a7 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:54:48.664048 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-6f21b20b-03ae-4a8c-9635-bccc479731a7 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:54:48.664484 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-6f21b20b-03ae-4a8c-9635-bccc479731a7 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:54:48.950807 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-6f21b20b-03ae-4a8c-9635-bccc479731a7 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eac41ce3f04450b840cff305ec1a5ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47e1ad014d542f98f6b24c8a504d166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:54:48.963422 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-6f21b20b-03ae-4a8c-9635-bccc479731a7 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] 10.222.0.20 "GET /compute/v2.1/servers/f236112c-4649-478b-a626-b84f8ff1bfe9" status: 200 len: 1242 microversion: 2.1 time: 0.325154 Jul 05 20:54:48.967038 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 27/61] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:54:48 2022] GET /compute/v2.1/servers/f236112c-4649-478b-a626-b84f8ff1bfe9 => generated 1242 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 20:54:49.127238 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-970be0d6-c65d-4b28-aa3e-23ebe3fc4743 tempest-DeleteServersTestJSON-389510094 tempest-DeleteServersTestJSON-389510094-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:54:49.127993 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-970be0d6-c65d-4b28-aa3e-23ebe3fc4743 tempest-DeleteServersTestJSON-389510094 tempest-DeleteServersTestJSON-389510094-project] [instance: 1159954e-7c69-48d8-b051-5a7b1108da69] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:54:49.137591 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-970be0d6-c65d-4b28-aa3e-23ebe3fc4743 tempest-DeleteServersTestJSON-389510094 tempest-DeleteServersTestJSON-389510094-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:54:49.138665 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-970be0d6-c65d-4b28-aa3e-23ebe3fc4743 tempest-DeleteServersTestJSON-389510094 tempest-DeleteServersTestJSON-389510094-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:54:49.139853 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-970be0d6-c65d-4b28-aa3e-23ebe3fc4743 tempest-DeleteServersTestJSON-389510094 tempest-DeleteServersTestJSON-389510094-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:54:49.140516 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-970be0d6-c65d-4b28-aa3e-23ebe3fc4743 tempest-DeleteServersTestJSON-389510094 tempest-DeleteServersTestJSON-389510094-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:54:49.496855 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.virt.hardware [None req-b31cefe1-cc52-4058-87d2-69bbd02674ed tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Flavor limits 0:0:0 {{(pid=117628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 05 20:54:49.497494 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.virt.hardware [None req-b31cefe1-cc52-4058-87d2-69bbd02674ed tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Image limits 0:0:0 {{(pid=117628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 05 20:54:49.498039 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.virt.hardware [None req-b31cefe1-cc52-4058-87d2-69bbd02674ed tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Flavor pref 0:0:0 {{(pid=117628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 05 20:54:49.498516 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.virt.hardware [None req-b31cefe1-cc52-4058-87d2-69bbd02674ed tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Image pref 0:0:0 {{(pid=117628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 05 20:54:49.499013 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.virt.hardware [None req-b31cefe1-cc52-4058-87d2-69bbd02674ed tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 05 20:54:49.513369 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-b31cefe1-cc52-4058-87d2-69bbd02674ed tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:54:49.515125 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-b31cefe1-cc52-4058-87d2-69bbd02674ed tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:54:49.529189 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-b31cefe1-cc52-4058-87d2-69bbd02674ed tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:54:49.530053 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-b31cefe1-cc52-4058-87d2-69bbd02674ed tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:54:49.572593 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.quota [None req-b31cefe1-cc52-4058-87d2-69bbd02674ed tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Getting quotas for project fc6d47f96d17471d94367bc8f8a3e3f6. Resources: {'cores', 'ram', 'instances'} {{(pid=117628) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 05 20:54:49.585654 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.quota [None req-b31cefe1-cc52-4058-87d2-69bbd02674ed tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Getting quotas for user d152763a64794301b21587ab2b395bbf and project fc6d47f96d17471d94367bc8f8a3e3f6. Resources: {'cores', 'ram', 'instances'} {{(pid=117628) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 05 20:54:49.607775 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-b31cefe1-cc52-4058-87d2-69bbd02674ed tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Going to run 1 instances... {{(pid=117628) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 05 20:54:49.611188 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-b31cefe1-cc52-4058-87d2-69bbd02674ed tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] [instance: 82ec9293-050f-48f2-b0fd-e563145c6cb3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='88e08f49-c01d-4849-a89f-b678588e56f4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117628) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 05 20:54:49.615890 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-970be0d6-c65d-4b28-aa3e-23ebe3fc4743 tempest-DeleteServersTestJSON-389510094 tempest-DeleteServersTestJSON-389510094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5063db22225a4d0b97ec5dcac8770045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '873a5ea6741e4762857e2bae05f5e06d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:54:49.631804 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-970be0d6-c65d-4b28-aa3e-23ebe3fc4743 tempest-DeleteServersTestJSON-389510094 tempest-DeleteServersTestJSON-389510094-project] 10.222.0.20 "GET /compute/v2.1/servers/1159954e-7c69-48d8-b051-5a7b1108da69" status: 200 len: 1315 microversion: 2.1 time: 0.514301 Jul 05 20:54:49.638672 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 28/62] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:54:49 2022] GET /compute/v2.1/servers/1159954e-7c69-48d8-b051-5a7b1108da69 => generated 1315 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 20:54:49.729255 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-b31cefe1-cc52-4058-87d2-69bbd02674ed tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.869899 Jul 05 20:54:49.731986 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 35/63] 10.222.0.20 () {60 vars in 1146 bytes} [Tue Jul 5 20:54:47 2022] POST /compute/v2.1/servers => generated 383 bytes in 1877 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 05 20:54:49.740600 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-3db7d8a8-6538-4c49-8cda-468b645b430a tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:54:49.741349 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-3db7d8a8-6538-4c49-8cda-468b645b430a tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] [instance: 82ec9293-050f-48f2-b0fd-e563145c6cb3] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:54:49.865045 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-3db7d8a8-6538-4c49-8cda-468b645b430a tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd152763a64794301b21587ab2b395bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc6d47f96d17471d94367bc8f8a3e3f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:54:49.875941 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-3db7d8a8-6538-4c49-8cda-468b645b430a tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] 10.222.0.20 "GET /compute/v2.1/servers/82ec9293-050f-48f2-b0fd-e563145c6cb3" status: 200 len: 1221 microversion: 2.1 time: 0.138269 Jul 05 20:54:49.886226 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 29/64] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:54:49 2022] GET /compute/v2.1/servers/82ec9293-050f-48f2-b0fd-e563145c6cb3 => generated 1221 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 20:54:49.984757 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-7a08f3c7-4dd7-447a-ac49-a8437a5f3cfc tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:54:49.985402 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-7a08f3c7-4dd7-447a-ac49-a8437a5f3cfc tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] [instance: f236112c-4649-478b-a626-b84f8ff1bfe9] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:54:50.004142 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-7a08f3c7-4dd7-447a-ac49-a8437a5f3cfc tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:54:50.005036 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-7a08f3c7-4dd7-447a-ac49-a8437a5f3cfc tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:54:50.008053 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-7a08f3c7-4dd7-447a-ac49-a8437a5f3cfc tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:54:50.011151 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-7a08f3c7-4dd7-447a-ac49-a8437a5f3cfc tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:54:50.226428 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-7a08f3c7-4dd7-447a-ac49-a8437a5f3cfc tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eac41ce3f04450b840cff305ec1a5ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47e1ad014d542f98f6b24c8a504d166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:54:50.236461 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-7a08f3c7-4dd7-447a-ac49-a8437a5f3cfc tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] 10.222.0.20 "GET /compute/v2.1/servers/f236112c-4649-478b-a626-b84f8ff1bfe9" status: 200 len: 1242 microversion: 2.1 time: 0.257311 Jul 05 20:54:50.256212 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 36/65] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:54:49 2022] GET /compute/v2.1/servers/f236112c-4649-478b-a626-b84f8ff1bfe9 => generated 1242 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 20:54:50.657583 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-e2e3ace3-525f-4867-8c79-87885022d042 tempest-DeleteServersTestJSON-389510094 tempest-DeleteServersTestJSON-389510094-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:54:50.661774 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-e2e3ace3-525f-4867-8c79-87885022d042 tempest-DeleteServersTestJSON-389510094 tempest-DeleteServersTestJSON-389510094-project] [instance: 1159954e-7c69-48d8-b051-5a7b1108da69] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:54:50.684750 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-e2e3ace3-525f-4867-8c79-87885022d042 tempest-DeleteServersTestJSON-389510094 tempest-DeleteServersTestJSON-389510094-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:54:50.685612 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-e2e3ace3-525f-4867-8c79-87885022d042 tempest-DeleteServersTestJSON-389510094 tempest-DeleteServersTestJSON-389510094-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:54:50.686606 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-e2e3ace3-525f-4867-8c79-87885022d042 tempest-DeleteServersTestJSON-389510094 tempest-DeleteServersTestJSON-389510094-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:54:50.687194 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-e2e3ace3-525f-4867-8c79-87885022d042 tempest-DeleteServersTestJSON-389510094 tempest-DeleteServersTestJSON-389510094-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:54:50.895385 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-099523c3-7dd8-4a3a-9960-036f069c2a0e tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:54:50.895998 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-099523c3-7dd8-4a3a-9960-036f069c2a0e tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] [instance: 82ec9293-050f-48f2-b0fd-e563145c6cb3] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:54:50.910856 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-099523c3-7dd8-4a3a-9960-036f069c2a0e tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:54:50.914830 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-099523c3-7dd8-4a3a-9960-036f069c2a0e tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:54:50.915381 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-099523c3-7dd8-4a3a-9960-036f069c2a0e tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:54:50.919407 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-099523c3-7dd8-4a3a-9960-036f069c2a0e tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:54:51.233196 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-099523c3-7dd8-4a3a-9960-036f069c2a0e tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd152763a64794301b21587ab2b395bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc6d47f96d17471d94367bc8f8a3e3f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:54:51.245512 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-099523c3-7dd8-4a3a-9960-036f069c2a0e tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] 10.222.0.20 "GET /compute/v2.1/servers/82ec9293-050f-48f2-b0fd-e563145c6cb3" status: 200 len: 1225 microversion: 2.1 time: 0.355237 Jul 05 20:54:51.257073 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 37/66] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:54:50 2022] GET /compute/v2.1/servers/82ec9293-050f-48f2-b0fd-e563145c6cb3 => generated 1225 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 20:54:51.267715 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-70c7bb20-682c-4222-ac2a-5dbecd19c26e tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:54:51.268341 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-70c7bb20-682c-4222-ac2a-5dbecd19c26e tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] [instance: f236112c-4649-478b-a626-b84f8ff1bfe9] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:54:51.306020 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-70c7bb20-682c-4222-ac2a-5dbecd19c26e tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:54:51.306483 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-70c7bb20-682c-4222-ac2a-5dbecd19c26e tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:54:51.313453 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-70c7bb20-682c-4222-ac2a-5dbecd19c26e tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:54:51.314050 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-70c7bb20-682c-4222-ac2a-5dbecd19c26e tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:54:51.353345 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-e2e3ace3-525f-4867-8c79-87885022d042 tempest-DeleteServersTestJSON-389510094 tempest-DeleteServersTestJSON-389510094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5063db22225a4d0b97ec5dcac8770045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '873a5ea6741e4762857e2bae05f5e06d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:54:51.362823 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-e2e3ace3-525f-4867-8c79-87885022d042 tempest-DeleteServersTestJSON-389510094 tempest-DeleteServersTestJSON-389510094-project] 10.222.0.20 "GET /compute/v2.1/servers/1159954e-7c69-48d8-b051-5a7b1108da69" status: 200 len: 1315 microversion: 2.1 time: 0.711171 Jul 05 20:54:51.376654 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 30/67] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:54:50 2022] GET /compute/v2.1/servers/1159954e-7c69-48d8-b051-5a7b1108da69 => generated 1315 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 20:54:51.507969 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-70c7bb20-682c-4222-ac2a-5dbecd19c26e tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eac41ce3f04450b840cff305ec1a5ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47e1ad014d542f98f6b24c8a504d166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:54:51.521543 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-70c7bb20-682c-4222-ac2a-5dbecd19c26e tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] 10.222.0.20 "GET /compute/v2.1/servers/f236112c-4649-478b-a626-b84f8ff1bfe9" status: 200 len: 1234 microversion: 2.1 time: 0.258558 Jul 05 20:54:51.522325 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 38/68] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:54:51 2022] GET /compute/v2.1/servers/f236112c-4649-478b-a626-b84f8ff1bfe9 => generated 1234 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 20:54:52.263475 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-902a728d-82d3-4c6f-acf6-76e5a3d4491e tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:54:52.264236 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-902a728d-82d3-4c6f-acf6-76e5a3d4491e tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] [instance: 82ec9293-050f-48f2-b0fd-e563145c6cb3] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:54:52.275916 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-902a728d-82d3-4c6f-acf6-76e5a3d4491e tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:54:52.277628 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-902a728d-82d3-4c6f-acf6-76e5a3d4491e tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:54:52.278816 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-902a728d-82d3-4c6f-acf6-76e5a3d4491e tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:54:52.281378 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-902a728d-82d3-4c6f-acf6-76e5a3d4491e tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:54:52.382215 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-0446472e-cd7c-419d-b991-075e169db3e9 tempest-DeleteServersTestJSON-389510094 tempest-DeleteServersTestJSON-389510094-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:54:52.382954 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-0446472e-cd7c-419d-b991-075e169db3e9 tempest-DeleteServersTestJSON-389510094 tempest-DeleteServersTestJSON-389510094-project] [instance: 1159954e-7c69-48d8-b051-5a7b1108da69] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:54:52.412664 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-0446472e-cd7c-419d-b991-075e169db3e9 tempest-DeleteServersTestJSON-389510094 tempest-DeleteServersTestJSON-389510094-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:54:52.428842 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-0446472e-cd7c-419d-b991-075e169db3e9 tempest-DeleteServersTestJSON-389510094 tempest-DeleteServersTestJSON-389510094-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:54:52.430441 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-0446472e-cd7c-419d-b991-075e169db3e9 tempest-DeleteServersTestJSON-389510094 tempest-DeleteServersTestJSON-389510094-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:54:52.433946 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-0446472e-cd7c-419d-b991-075e169db3e9 tempest-DeleteServersTestJSON-389510094 tempest-DeleteServersTestJSON-389510094-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:54:52.506134 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-902a728d-82d3-4c6f-acf6-76e5a3d4491e tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd152763a64794301b21587ab2b395bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc6d47f96d17471d94367bc8f8a3e3f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:54:52.542205 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-902a728d-82d3-4c6f-acf6-76e5a3d4491e tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] 10.222.0.20 "GET /compute/v2.1/servers/82ec9293-050f-48f2-b0fd-e563145c6cb3" status: 200 len: 1217 microversion: 2.1 time: 0.261966 Jul 05 20:54:52.545605 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 31/69] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:54:52 2022] GET /compute/v2.1/servers/82ec9293-050f-48f2-b0fd-e563145c6cb3 => generated 1217 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 20:54:52.573110 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-cf940000-5172-47b9-bab0-1d07a24f4fdf tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:54:52.575717 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-cf940000-5172-47b9-bab0-1d07a24f4fdf tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] [instance: f236112c-4649-478b-a626-b84f8ff1bfe9] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:54:52.620172 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-cf940000-5172-47b9-bab0-1d07a24f4fdf tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:54:52.622763 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-cf940000-5172-47b9-bab0-1d07a24f4fdf tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:54:52.623746 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-cf940000-5172-47b9-bab0-1d07a24f4fdf tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:54:52.625570 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-cf940000-5172-47b9-bab0-1d07a24f4fdf tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:54:53.233670 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-cf940000-5172-47b9-bab0-1d07a24f4fdf tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eac41ce3f04450b840cff305ec1a5ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47e1ad014d542f98f6b24c8a504d166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:54:53.247531 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-cf940000-5172-47b9-bab0-1d07a24f4fdf tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] 10.222.0.20 "GET /compute/v2.1/servers/f236112c-4649-478b-a626-b84f8ff1bfe9" status: 200 len: 1290 microversion: 2.1 time: 0.698383 Jul 05 20:54:53.251081 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 32/70] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:54:52 2022] GET /compute/v2.1/servers/f236112c-4649-478b-a626-b84f8ff1bfe9 => generated 1290 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 20:54:53.265213 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-07efc2ce-7df7-4081-9a81-53602384bcbf tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-852717393", "imageRef": "88e08f49-c01d-4849-a89f-b678588e56f4", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e74f1f51-bd28-4e7f-8e84-8ec196c505a4"}], "security_groups": [{"name": "tempest-securitygroup--514119482"}], "key_name": "tempest-keypair-659881", "user_data": "}} {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 20:54:53.922592 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-0446472e-cd7c-419d-b991-075e169db3e9 tempest-DeleteServersTestJSON-389510094 tempest-DeleteServersTestJSON-389510094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5063db22225a4d0b97ec5dcac8770045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '873a5ea6741e4762857e2bae05f5e06d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:54:53.937725 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-0446472e-cd7c-419d-b991-075e169db3e9 tempest-DeleteServersTestJSON-389510094 tempest-DeleteServersTestJSON-389510094-project] 10.222.0.20 "GET /compute/v2.1/servers/1159954e-7c69-48d8-b051-5a7b1108da69" status: 200 len: 1315 microversion: 2.1 time: 1.561387 Jul 05 20:54:53.939479 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 39/71] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:54:52 2022] GET /compute/v2.1/servers/1159954e-7c69-48d8-b051-5a7b1108da69 => generated 1315 bytes in 1564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 20:54:53.942675 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.network.neutron [None req-07efc2ce-7df7-4081-9a81-53602384bcbf tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] validate_networks() for [('e74f1f51-bd28-4e7f-8e84-8ec196c505a4', None, None, None, None, None)] {{(pid=117627) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 05 20:54:53.961694 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-437eae53-8c39-446d-9568-42dcd7d48602 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:54:53.963720 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-437eae53-8c39-446d-9568-42dcd7d48602 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] [instance: 82ec9293-050f-48f2-b0fd-e563145c6cb3] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:54:53.977903 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-437eae53-8c39-446d-9568-42dcd7d48602 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:54:53.978623 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-437eae53-8c39-446d-9568-42dcd7d48602 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:54:53.979636 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-437eae53-8c39-446d-9568-42dcd7d48602 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:54:53.980477 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-437eae53-8c39-446d-9568-42dcd7d48602 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:54:54.222451 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-437eae53-8c39-446d-9568-42dcd7d48602 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd152763a64794301b21587ab2b395bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc6d47f96d17471d94367bc8f8a3e3f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:54:54.231943 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-437eae53-8c39-446d-9568-42dcd7d48602 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] 10.222.0.20 "GET /compute/v2.1/servers/82ec9293-050f-48f2-b0fd-e563145c6cb3" status: 200 len: 1291 microversion: 2.1 time: 0.282254 Jul 05 20:54:54.232537 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 40/72] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:54:53 2022] GET /compute/v2.1/servers/82ec9293-050f-48f2-b0fd-e563145c6cb3 => generated 1291 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 20:54:54.265189 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-037f132b-a038-445c-bced-30047ae97a89 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:54:54.265856 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-037f132b-a038-445c-bced-30047ae97a89 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] [instance: f236112c-4649-478b-a626-b84f8ff1bfe9] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:54:54.285917 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-037f132b-a038-445c-bced-30047ae97a89 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:54:54.285917 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-037f132b-a038-445c-bced-30047ae97a89 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:54:54.286736 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-037f132b-a038-445c-bced-30047ae97a89 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:54:54.288231 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-037f132b-a038-445c-bced-30047ae97a89 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:54:54.456411 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-037f132b-a038-445c-bced-30047ae97a89 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eac41ce3f04450b840cff305ec1a5ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47e1ad014d542f98f6b24c8a504d166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:54:54.466828 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-037f132b-a038-445c-bced-30047ae97a89 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] 10.222.0.20 "GET /compute/v2.1/servers/f236112c-4649-478b-a626-b84f8ff1bfe9" status: 200 len: 1296 microversion: 2.1 time: 0.205836 Jul 05 20:54:54.473450 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 41/73] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:54:54 2022] GET /compute/v2.1/servers/f236112c-4649-478b-a626-b84f8ff1bfe9 => generated 1296 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 20:54:54.955905 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-897a82fc-ba83-456b-9434-094fff029e49 tempest-DeleteServersTestJSON-389510094 tempest-DeleteServersTestJSON-389510094-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:54:54.957547 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-897a82fc-ba83-456b-9434-094fff029e49 tempest-DeleteServersTestJSON-389510094 tempest-DeleteServersTestJSON-389510094-project] [instance: 1159954e-7c69-48d8-b051-5a7b1108da69] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:54:54.968211 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-897a82fc-ba83-456b-9434-094fff029e49 tempest-DeleteServersTestJSON-389510094 tempest-DeleteServersTestJSON-389510094-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:54:54.968739 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-897a82fc-ba83-456b-9434-094fff029e49 tempest-DeleteServersTestJSON-389510094 tempest-DeleteServersTestJSON-389510094-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:54:54.969632 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-897a82fc-ba83-456b-9434-094fff029e49 tempest-DeleteServersTestJSON-389510094 tempest-DeleteServersTestJSON-389510094-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:54:54.973778 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-897a82fc-ba83-456b-9434-094fff029e49 tempest-DeleteServersTestJSON-389510094 tempest-DeleteServersTestJSON-389510094-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:54:55.258353 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.virt.hardware [None req-07efc2ce-7df7-4081-9a81-53602384bcbf tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Flavor limits 0:0:0 {{(pid=117627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 05 20:54:55.258800 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.virt.hardware [None req-07efc2ce-7df7-4081-9a81-53602384bcbf tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Image limits 0:0:0 {{(pid=117627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 05 20:54:55.259225 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.virt.hardware [None req-07efc2ce-7df7-4081-9a81-53602384bcbf tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Flavor pref 0:0:0 {{(pid=117627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 05 20:54:55.259631 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.virt.hardware [None req-07efc2ce-7df7-4081-9a81-53602384bcbf tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Image pref 0:0:0 {{(pid=117627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 05 20:54:55.260029 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.virt.hardware [None req-07efc2ce-7df7-4081-9a81-53602384bcbf tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 05 20:54:55.279412 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-07efc2ce-7df7-4081-9a81-53602384bcbf tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:54:55.280093 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-07efc2ce-7df7-4081-9a81-53602384bcbf tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:54:55.283929 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-07efc2ce-7df7-4081-9a81-53602384bcbf tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:54:55.284541 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-07efc2ce-7df7-4081-9a81-53602384bcbf tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:54:55.312722 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG dbcounter [-] [117627] Writing DB stats nova_cell1:SELECT=75 {{(pid=117627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:54:55.343218 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.quota [None req-07efc2ce-7df7-4081-9a81-53602384bcbf tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Getting quotas for project 9c5fb5bc86604f38b5f0f3a46525189a. Resources: {'cores', 'ram', 'instances'} {{(pid=117627) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 05 20:54:55.349302 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.quota [None req-07efc2ce-7df7-4081-9a81-53602384bcbf tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Getting quotas for user a3792881ae73408db651dd6eb09b3d25 and project 9c5fb5bc86604f38b5f0f3a46525189a. Resources: {'cores', 'ram', 'instances'} {{(pid=117627) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 05 20:54:55.372848 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-07efc2ce-7df7-4081-9a81-53602384bcbf tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Going to run 1 instances... {{(pid=117627) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 05 20:54:55.388023 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-07efc2ce-7df7-4081-9a81-53602384bcbf tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] [instance: 52848078-62a1-484f-813c-7b3352cb3851] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='88e08f49-c01d-4849-a89f-b678588e56f4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117627) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 05 20:54:55.489410 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-07efc2ce-7df7-4081-9a81-53602384bcbf tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 2.234360 Jul 05 20:54:55.490903 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 33/74] 10.222.0.20 () {62 vars in 1187 bytes} [Tue Jul 5 20:54:53 2022] POST /compute/v2.1/servers => generated 401 bytes in 2239 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 05 20:54:55.676146 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-897a82fc-ba83-456b-9434-094fff029e49 tempest-DeleteServersTestJSON-389510094 tempest-DeleteServersTestJSON-389510094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5063db22225a4d0b97ec5dcac8770045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '873a5ea6741e4762857e2bae05f5e06d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:54:55.702269 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-897a82fc-ba83-456b-9434-094fff029e49 tempest-DeleteServersTestJSON-389510094 tempest-DeleteServersTestJSON-389510094-project] 10.222.0.20 "GET /compute/v2.1/servers/1159954e-7c69-48d8-b051-5a7b1108da69" status: 200 len: 1315 microversion: 2.1 time: 0.748888 Jul 05 20:54:55.705367 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 42/75] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:54:54 2022] GET /compute/v2.1/servers/1159954e-7c69-48d8-b051-5a7b1108da69 => generated 1315 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 20:54:55.714187 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-c7698cb8-8ceb-474d-9b88-5b5c6fd9047b tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:54:55.715101 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-c7698cb8-8ceb-474d-9b88-5b5c6fd9047b tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] [instance: 82ec9293-050f-48f2-b0fd-e563145c6cb3] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:54:55.724762 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-c7698cb8-8ceb-474d-9b88-5b5c6fd9047b tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:54:55.725737 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-c7698cb8-8ceb-474d-9b88-5b5c6fd9047b tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:54:55.727012 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-c7698cb8-8ceb-474d-9b88-5b5c6fd9047b tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:54:55.727784 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-c7698cb8-8ceb-474d-9b88-5b5c6fd9047b tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:54:55.840672 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [req-b78191e3-7955-4aec-9bf6-526c1b367b8e req-4750a7ac-e0b3-4747-82a8-2089331cc5f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1159954e-7c69-48d8-b051-5a7b1108da69", "name": "network-vif-plugged", "status": "completed", "tag": "c23f1cb7-7c8c-45f8-b9aa-1642f642532e"}]} {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 20:54:55.854392 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [req-b78191e3-7955-4aec-9bf6-526c1b367b8e req-4750a7ac-e0b3-4747-82a8-2089331cc5f6 service nova] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:54:55.857746 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [req-b78191e3-7955-4aec-9bf6-526c1b367b8e req-4750a7ac-e0b3-4747-82a8-2089331cc5f6 service nova] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:54:55.886255 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.compute.server_external_events [req-b78191e3-7955-4aec-9bf6-526c1b367b8e req-4750a7ac-e0b3-4747-82a8-2089331cc5f6 service nova] Creating event network-vif-plugged:c23f1cb7-7c8c-45f8-b9aa-1642f642532e for instance 1159954e-7c69-48d8-b051-5a7b1108da69 on hv-cinder-79760 Jul 05 20:54:55.899521 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [req-b78191e3-7955-4aec-9bf6-526c1b367b8e req-4750a7ac-e0b3-4747-82a8-2089331cc5f6 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.406065 Jul 05 20:54:55.904913 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 34/76] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 5 20:54:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 20:54:55.914384 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-0f78a694-4413-4eb9-9f88-42f6d3a4d96b tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:54:55.915411 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-0f78a694-4413-4eb9-9f88-42f6d3a4d96b tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] [instance: f236112c-4649-478b-a626-b84f8ff1bfe9] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:54:55.924033 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-0f78a694-4413-4eb9-9f88-42f6d3a4d96b tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:54:55.925288 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-0f78a694-4413-4eb9-9f88-42f6d3a4d96b tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:54:55.926414 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-0f78a694-4413-4eb9-9f88-42f6d3a4d96b tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:54:55.926987 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-0f78a694-4413-4eb9-9f88-42f6d3a4d96b tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:54:55.927535 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-c7698cb8-8ceb-474d-9b88-5b5c6fd9047b tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd152763a64794301b21587ab2b395bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc6d47f96d17471d94367bc8f8a3e3f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:54:55.942172 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-c7698cb8-8ceb-474d-9b88-5b5c6fd9047b tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] 10.222.0.20 "GET /compute/v2.1/servers/82ec9293-050f-48f2-b0fd-e563145c6cb3" status: 200 len: 1279 microversion: 2.1 time: 0.235481 Jul 05 20:54:55.945417 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 43/77] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:54:55 2022] GET /compute/v2.1/servers/82ec9293-050f-48f2-b0fd-e563145c6cb3 => generated 1279 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 20:54:55.953419 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-b5c8015a-47eb-4718-9129-12e6a389e19e tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:54:55.959995 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-b5c8015a-47eb-4718-9129-12e6a389e19e tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] [instance: 52848078-62a1-484f-813c-7b3352cb3851] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:54:55.968405 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG dbcounter [-] [117628] Writing DB stats nova_api:SELECT=77,nova_api:INSERT=8 {{(pid=117628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:54:56.261832 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-b5c8015a-47eb-4718-9129-12e6a389e19e tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:54:56.274639 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-b5c8015a-47eb-4718-9129-12e6a389e19e tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:54:56.287658 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-b5c8015a-47eb-4718-9129-12e6a389e19e tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:54:56.289540 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-b5c8015a-47eb-4718-9129-12e6a389e19e tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] 10.222.0.20 "GET /compute/v2.1/servers/52848078-62a1-484f-813c-7b3352cb3851" status: 200 len: 1277 microversion: 2.20 time: 0.341648 Jul 05 20:54:56.290274 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 44/78] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 5 20:54:55 2022] GET /compute/v2.1/servers/52848078-62a1-484f-813c-7b3352cb3851 => generated 1277 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 20:54:56.722877 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-8ed6f27c-9b68-493f-aa55-1f28f6f85ea4 tempest-DeleteServersTestJSON-389510094 tempest-DeleteServersTestJSON-389510094-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:54:56.723789 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-8ed6f27c-9b68-493f-aa55-1f28f6f85ea4 tempest-DeleteServersTestJSON-389510094 tempest-DeleteServersTestJSON-389510094-project] [instance: 1159954e-7c69-48d8-b051-5a7b1108da69] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:54:56.734220 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-8ed6f27c-9b68-493f-aa55-1f28f6f85ea4 tempest-DeleteServersTestJSON-389510094 tempest-DeleteServersTestJSON-389510094-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:54:56.734878 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-8ed6f27c-9b68-493f-aa55-1f28f6f85ea4 tempest-DeleteServersTestJSON-389510094 tempest-DeleteServersTestJSON-389510094-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:54:56.736659 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-8ed6f27c-9b68-493f-aa55-1f28f6f85ea4 tempest-DeleteServersTestJSON-389510094 tempest-DeleteServersTestJSON-389510094-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:54:56.737322 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-8ed6f27c-9b68-493f-aa55-1f28f6f85ea4 tempest-DeleteServersTestJSON-389510094 tempest-DeleteServersTestJSON-389510094-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:54:57.152021 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-0f78a694-4413-4eb9-9f88-42f6d3a4d96b tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eac41ce3f04450b840cff305ec1a5ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47e1ad014d542f98f6b24c8a504d166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:54:57.161303 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-0f78a694-4413-4eb9-9f88-42f6d3a4d96b tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] 10.222.0.20 "GET /compute/v2.1/servers/f236112c-4649-478b-a626-b84f8ff1bfe9" status: 200 len: 1363 microversion: 2.1 time: 1.254567 Jul 05 20:54:57.161881 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 35/79] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:54:55 2022] GET /compute/v2.1/servers/f236112c-4649-478b-a626-b84f8ff1bfe9 => generated 1363 bytes in 1256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 20:54:57.167193 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-d02e967f-455f-45ad-aa80-9b5fc60779fe tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:54:57.167973 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-d02e967f-455f-45ad-aa80-9b5fc60779fe tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] [instance: 82ec9293-050f-48f2-b0fd-e563145c6cb3] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:54:57.174166 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-d02e967f-455f-45ad-aa80-9b5fc60779fe tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:54:57.174602 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-d02e967f-455f-45ad-aa80-9b5fc60779fe tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:54:57.175527 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-d02e967f-455f-45ad-aa80-9b5fc60779fe tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:54:57.175962 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-d02e967f-455f-45ad-aa80-9b5fc60779fe tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:54:57.288909 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-d02e967f-455f-45ad-aa80-9b5fc60779fe tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd152763a64794301b21587ab2b395bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc6d47f96d17471d94367bc8f8a3e3f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:54:57.297199 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-d02e967f-455f-45ad-aa80-9b5fc60779fe tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] 10.222.0.20 "GET /compute/v2.1/servers/82ec9293-050f-48f2-b0fd-e563145c6cb3" status: 200 len: 1279 microversion: 2.1 time: 0.133733 Jul 05 20:54:57.310883 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 36/80] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:54:57 2022] GET /compute/v2.1/servers/82ec9293-050f-48f2-b0fd-e563145c6cb3 => generated 1279 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 20:54:57.316820 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-8ed6f27c-9b68-493f-aa55-1f28f6f85ea4 tempest-DeleteServersTestJSON-389510094 tempest-DeleteServersTestJSON-389510094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5063db22225a4d0b97ec5dcac8770045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '873a5ea6741e4762857e2bae05f5e06d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:54:57.317948 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-00832ed9-0450-440a-8f05-b5a1e5004e9d tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:54:57.318769 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-00832ed9-0450-440a-8f05-b5a1e5004e9d tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] [instance: 52848078-62a1-484f-813c-7b3352cb3851] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:54:57.325702 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-00832ed9-0450-440a-8f05-b5a1e5004e9d tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:54:57.326450 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-00832ed9-0450-440a-8f05-b5a1e5004e9d tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:54:57.327499 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-00832ed9-0450-440a-8f05-b5a1e5004e9d tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:54:57.328096 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-00832ed9-0450-440a-8f05-b5a1e5004e9d tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:54:57.329318 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-8ed6f27c-9b68-493f-aa55-1f28f6f85ea4 tempest-DeleteServersTestJSON-389510094 tempest-DeleteServersTestJSON-389510094-project] 10.222.0.20 "GET /compute/v2.1/servers/1159954e-7c69-48d8-b051-5a7b1108da69" status: 200 len: 1315 microversion: 2.1 time: 0.611362 Jul 05 20:54:57.329921 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 45/81] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:54:56 2022] GET /compute/v2.1/servers/1159954e-7c69-48d8-b051-5a7b1108da69 => generated 1315 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 20:54:57.513489 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-00832ed9-0450-440a-8f05-b5a1e5004e9d tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:54:57.536489 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-00832ed9-0450-440a-8f05-b5a1e5004e9d tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:54:57.539226 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-00832ed9-0450-440a-8f05-b5a1e5004e9d tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:54:57.541859 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-00832ed9-0450-440a-8f05-b5a1e5004e9d tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] 10.222.0.20 "GET /compute/v2.1/servers/52848078-62a1-484f-813c-7b3352cb3851" status: 200 len: 1329 microversion: 2.20 time: 0.229697 Jul 05 20:54:57.545550 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 37/82] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 5 20:54:57 2022] GET /compute/v2.1/servers/52848078-62a1-484f-813c-7b3352cb3851 => generated 1329 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 20:54:58.180209 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-cd8dbe1f-979d-4c4b-9f6a-ce408d9f76ee tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:54:58.181180 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-cd8dbe1f-979d-4c4b-9f6a-ce408d9f76ee tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] [instance: f236112c-4649-478b-a626-b84f8ff1bfe9] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:54:58.203235 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-cd8dbe1f-979d-4c4b-9f6a-ce408d9f76ee tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:54:58.205795 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-cd8dbe1f-979d-4c4b-9f6a-ce408d9f76ee tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:54:58.208976 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-cd8dbe1f-979d-4c4b-9f6a-ce408d9f76ee tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:54:58.210266 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-cd8dbe1f-979d-4c4b-9f6a-ce408d9f76ee tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:54:58.326844 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-1fa58545-0d13-4a90-bb7d-68285d9c83ec tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:54:58.328788 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-1fa58545-0d13-4a90-bb7d-68285d9c83ec tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] [instance: 82ec9293-050f-48f2-b0fd-e563145c6cb3] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:54:58.365357 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-1fa58545-0d13-4a90-bb7d-68285d9c83ec tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:54:58.368103 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-1fa58545-0d13-4a90-bb7d-68285d9c83ec tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:54:58.374098 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-1fa58545-0d13-4a90-bb7d-68285d9c83ec tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:54:58.376872 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-1fa58545-0d13-4a90-bb7d-68285d9c83ec tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:54:58.862739 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-cd8dbe1f-979d-4c4b-9f6a-ce408d9f76ee tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eac41ce3f04450b840cff305ec1a5ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47e1ad014d542f98f6b24c8a504d166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:54:58.882908 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-cd8dbe1f-979d-4c4b-9f6a-ce408d9f76ee tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] 10.222.0.20 "GET /compute/v2.1/servers/f236112c-4649-478b-a626-b84f8ff1bfe9" status: 200 len: 1363 microversion: 2.1 time: 0.706873 Jul 05 20:54:58.885370 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 46/83] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:54:58 2022] GET /compute/v2.1/servers/f236112c-4649-478b-a626-b84f8ff1bfe9 => generated 1363 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 20:54:58.913122 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-48cf2233-82f2-4718-961f-efdb9f475013 tempest-DeleteServersTestJSON-389510094 tempest-DeleteServersTestJSON-389510094-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:54:58.914526 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-48cf2233-82f2-4718-961f-efdb9f475013 tempest-DeleteServersTestJSON-389510094 tempest-DeleteServersTestJSON-389510094-project] [instance: 1159954e-7c69-48d8-b051-5a7b1108da69] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:54:58.928470 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-48cf2233-82f2-4718-961f-efdb9f475013 tempest-DeleteServersTestJSON-389510094 tempest-DeleteServersTestJSON-389510094-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:54:58.932303 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-48cf2233-82f2-4718-961f-efdb9f475013 tempest-DeleteServersTestJSON-389510094 tempest-DeleteServersTestJSON-389510094-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:54:58.933141 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-48cf2233-82f2-4718-961f-efdb9f475013 tempest-DeleteServersTestJSON-389510094 tempest-DeleteServersTestJSON-389510094-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:54:58.934079 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-48cf2233-82f2-4718-961f-efdb9f475013 tempest-DeleteServersTestJSON-389510094 tempest-DeleteServersTestJSON-389510094-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:54:59.161340 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-1fa58545-0d13-4a90-bb7d-68285d9c83ec tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd152763a64794301b21587ab2b395bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc6d47f96d17471d94367bc8f8a3e3f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:54:59.176528 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-1fa58545-0d13-4a90-bb7d-68285d9c83ec tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] 10.222.0.20 "GET /compute/v2.1/servers/82ec9293-050f-48f2-b0fd-e563145c6cb3" status: 200 len: 1321 microversion: 2.1 time: 0.864640 Jul 05 20:54:59.179032 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 38/84] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:54:58 2022] GET /compute/v2.1/servers/82ec9293-050f-48f2-b0fd-e563145c6cb3 => generated 1321 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 20:54:59.191966 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-36ed08a1-0dd3-41c6-ab97-504c7318b75f tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:54:59.193774 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-36ed08a1-0dd3-41c6-ab97-504c7318b75f tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] [instance: 52848078-62a1-484f-813c-7b3352cb3851] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:54:59.212488 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-36ed08a1-0dd3-41c6-ab97-504c7318b75f tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:54:59.212872 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-36ed08a1-0dd3-41c6-ab97-504c7318b75f tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:54:59.213791 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-36ed08a1-0dd3-41c6-ab97-504c7318b75f tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:54:59.214231 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-36ed08a1-0dd3-41c6-ab97-504c7318b75f tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:54:59.501612 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-36ed08a1-0dd3-41c6-ab97-504c7318b75f tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:54:59.510731 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-36ed08a1-0dd3-41c6-ab97-504c7318b75f tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:54:59.512263 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-36ed08a1-0dd3-41c6-ab97-504c7318b75f tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:54:59.513453 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-36ed08a1-0dd3-41c6-ab97-504c7318b75f tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] 10.222.0.20 "GET /compute/v2.1/servers/52848078-62a1-484f-813c-7b3352cb3851" status: 200 len: 1335 microversion: 2.20 time: 0.332798 Jul 05 20:54:59.521517 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 39/85] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 5 20:54:59 2022] GET /compute/v2.1/servers/52848078-62a1-484f-813c-7b3352cb3851 => generated 1335 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 20:54:59.533468 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [req-ce894709-1446-4c62-bd2e-4875b16a3f79 req-da5ab24b-9026-4d76-aa70-2d5562e0d1c7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f236112c-4649-478b-a626-b84f8ff1bfe9", "tag": "63ac1cb2-ef2b-47e3-9bb9-22cffd540dec"}]} {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 20:54:59.547005 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [req-ce894709-1446-4c62-bd2e-4875b16a3f79 req-da5ab24b-9026-4d76-aa70-2d5562e0d1c7 service nova] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:54:59.550683 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [req-ce894709-1446-4c62-bd2e-4875b16a3f79 req-da5ab24b-9026-4d76-aa70-2d5562e0d1c7 service nova] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:54:59.554291 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG dbcounter [-] [117628] Writing DB stats nova_cell0:SELECT=4 {{(pid=117628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:54:59.568283 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.compute.server_external_events [req-ce894709-1446-4c62-bd2e-4875b16a3f79 req-da5ab24b-9026-4d76-aa70-2d5562e0d1c7 service nova] Creating event network-changed:63ac1cb2-ef2b-47e3-9bb9-22cffd540dec for instance f236112c-4649-478b-a626-b84f8ff1bfe9 on hv-cinder-79760 Jul 05 20:54:59.593495 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [req-ce894709-1446-4c62-bd2e-4875b16a3f79 req-da5ab24b-9026-4d76-aa70-2d5562e0d1c7 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069662 Jul 05 20:54:59.594127 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 40/86] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 5 20:54:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 20:54:59.809921 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-48cf2233-82f2-4718-961f-efdb9f475013 tempest-DeleteServersTestJSON-389510094 tempest-DeleteServersTestJSON-389510094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5063db22225a4d0b97ec5dcac8770045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '873a5ea6741e4762857e2bae05f5e06d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:54:59.830005 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-48cf2233-82f2-4718-961f-efdb9f475013 tempest-DeleteServersTestJSON-389510094 tempest-DeleteServersTestJSON-389510094-project] 10.222.0.20 "GET /compute/v2.1/servers/1159954e-7c69-48d8-b051-5a7b1108da69" status: 200 len: 1502 microversion: 2.1 time: 0.938101 Jul 05 20:54:59.830598 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 47/87] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:54:58 2022] GET /compute/v2.1/servers/1159954e-7c69-48d8-b051-5a7b1108da69 => generated 1502 bytes in 943 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 20:54:59.902817 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-d866b895-32fe-4b51-b5cc-d4b59fb7a6a2 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:54:59.903450 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-d866b895-32fe-4b51-b5cc-d4b59fb7a6a2 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] [instance: f236112c-4649-478b-a626-b84f8ff1bfe9] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:54:59.914442 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-d866b895-32fe-4b51-b5cc-d4b59fb7a6a2 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:54:59.915314 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-d866b895-32fe-4b51-b5cc-d4b59fb7a6a2 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:54:59.917269 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-d866b895-32fe-4b51-b5cc-d4b59fb7a6a2 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:54:59.919776 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-d866b895-32fe-4b51-b5cc-d4b59fb7a6a2 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:54:59.966902 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [req-ea2b3835-7b7f-454e-ba21-36c45835f614 req-b571b3fe-a754-42d2-863e-d8439f8bf7aa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a3aeae5c-d73d-4fb3-afa0-ee691e6a4fd4", "tag": "9d4d8d62-90d7-4b09-8e51-523c69e6c012"}]} {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 20:54:59.989877 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [req-ea2b3835-7b7f-454e-ba21-36c45835f614 req-b571b3fe-a754-42d2-863e-d8439f8bf7aa service nova] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:54:59.990896 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [req-ea2b3835-7b7f-454e-ba21-36c45835f614 req-b571b3fe-a754-42d2-863e-d8439f8bf7aa service nova] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:55:00.003582 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.compute.server_external_events [req-ea2b3835-7b7f-454e-ba21-36c45835f614 req-b571b3fe-a754-42d2-863e-d8439f8bf7aa service nova] Creating event network-changed:9d4d8d62-90d7-4b09-8e51-523c69e6c012 for instance a3aeae5c-d73d-4fb3-afa0-ee691e6a4fd4 on hv-cinder-79760 Jul 05 20:55:00.009170 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [req-ea2b3835-7b7f-454e-ba21-36c45835f614 req-b571b3fe-a754-42d2-863e-d8439f8bf7aa service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.413703 Jul 05 20:55:00.009961 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 41/88] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 5 20:54:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 20:55:00.198253 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-d1e0e084-7cb0-47ed-9b5f-a99852438d50 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:55:00.199230 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-d1e0e084-7cb0-47ed-9b5f-a99852438d50 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] [instance: 82ec9293-050f-48f2-b0fd-e563145c6cb3] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:55:00.210344 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-d1e0e084-7cb0-47ed-9b5f-a99852438d50 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:55:00.211050 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-d1e0e084-7cb0-47ed-9b5f-a99852438d50 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:55:00.213305 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-d1e0e084-7cb0-47ed-9b5f-a99852438d50 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:55:00.214535 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-d1e0e084-7cb0-47ed-9b5f-a99852438d50 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:55:00.394836 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-d866b895-32fe-4b51-b5cc-d4b59fb7a6a2 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eac41ce3f04450b840cff305ec1a5ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47e1ad014d542f98f6b24c8a504d166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:55:00.413995 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-d866b895-32fe-4b51-b5cc-d4b59fb7a6a2 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] 10.222.0.20 "GET /compute/v2.1/servers/f236112c-4649-478b-a626-b84f8ff1bfe9" status: 200 len: 1363 microversion: 2.1 time: 0.515384 Jul 05 20:55:00.414904 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 48/89] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:54:59 2022] GET /compute/v2.1/servers/f236112c-4649-478b-a626-b84f8ff1bfe9 => generated 1363 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 20:55:00.539812 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-bdf862b6-8d53-41d9-b816-55bc65ed3153 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:55:00.540423 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-bdf862b6-8d53-41d9-b816-55bc65ed3153 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] [instance: 52848078-62a1-484f-813c-7b3352cb3851] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:55:00.556503 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-bdf862b6-8d53-41d9-b816-55bc65ed3153 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:55:00.556979 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-bdf862b6-8d53-41d9-b816-55bc65ed3153 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:55:00.557756 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-bdf862b6-8d53-41d9-b816-55bc65ed3153 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:55:00.558189 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-bdf862b6-8d53-41d9-b816-55bc65ed3153 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:55:00.611544 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-d1e0e084-7cb0-47ed-9b5f-a99852438d50 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd152763a64794301b21587ab2b395bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc6d47f96d17471d94367bc8f8a3e3f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:55:00.623789 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-d1e0e084-7cb0-47ed-9b5f-a99852438d50 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] 10.222.0.20 "GET /compute/v2.1/servers/82ec9293-050f-48f2-b0fd-e563145c6cb3" status: 200 len: 1321 microversion: 2.1 time: 0.432415 Jul 05 20:55:00.633113 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 42/90] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:55:00 2022] GET /compute/v2.1/servers/82ec9293-050f-48f2-b0fd-e563145c6cb3 => generated 1321 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 20:55:00.890777 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-bdf862b6-8d53-41d9-b816-55bc65ed3153 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:55:00.900992 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-bdf862b6-8d53-41d9-b816-55bc65ed3153 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:55:00.902851 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-bdf862b6-8d53-41d9-b816-55bc65ed3153 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:55:00.906368 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-bdf862b6-8d53-41d9-b816-55bc65ed3153 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] 10.222.0.20 "GET /compute/v2.1/servers/52848078-62a1-484f-813c-7b3352cb3851" status: 200 len: 1402 microversion: 2.20 time: 0.368122 Jul 05 20:55:00.906540 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 49/91] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 5 20:55:00 2022] GET /compute/v2.1/servers/52848078-62a1-484f-813c-7b3352cb3851 => generated 1402 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 05 20:55:01.432016 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-ece5db88-b9a3-4e46-b7ad-046bf9663419 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:55:01.432632 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-ece5db88-b9a3-4e46-b7ad-046bf9663419 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] [instance: f236112c-4649-478b-a626-b84f8ff1bfe9] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:55:01.439010 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-ece5db88-b9a3-4e46-b7ad-046bf9663419 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:55:01.439459 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-ece5db88-b9a3-4e46-b7ad-046bf9663419 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:55:01.440210 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-ece5db88-b9a3-4e46-b7ad-046bf9663419 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:55:01.440705 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-ece5db88-b9a3-4e46-b7ad-046bf9663419 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:55:01.579387 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-ece5db88-b9a3-4e46-b7ad-046bf9663419 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eac41ce3f04450b840cff305ec1a5ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47e1ad014d542f98f6b24c8a504d166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:55:01.587552 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-ece5db88-b9a3-4e46-b7ad-046bf9663419 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] 10.222.0.20 "GET /compute/v2.1/servers/f236112c-4649-478b-a626-b84f8ff1bfe9" status: 200 len: 1363 microversion: 2.1 time: 0.159909 Jul 05 20:55:01.588113 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 43/92] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:55:01 2022] GET /compute/v2.1/servers/f236112c-4649-478b-a626-b84f8ff1bfe9 => generated 1363 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 20:55:01.627753 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [req-b25f6df7-3f06-438c-a0cb-f49df8901e22 req-c05d0de0-2149-41de-ba03-f5facedd6aca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "82ec9293-050f-48f2-b0fd-e563145c6cb3", "tag": "18b93783-3039-4fd9-b75c-752a99040bff"}]} {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 20:55:01.638583 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [req-b25f6df7-3f06-438c-a0cb-f49df8901e22 req-c05d0de0-2149-41de-ba03-f5facedd6aca service nova] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:55:01.639016 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [req-b25f6df7-3f06-438c-a0cb-f49df8901e22 req-c05d0de0-2149-41de-ba03-f5facedd6aca service nova] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:55:01.640640 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-82e2c3bf-e837-4958-83a8-9b59a89482a4 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:55:01.641294 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-82e2c3bf-e837-4958-83a8-9b59a89482a4 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] [instance: 82ec9293-050f-48f2-b0fd-e563145c6cb3] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:55:01.648211 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-82e2c3bf-e837-4958-83a8-9b59a89482a4 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:55:01.648529 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-82e2c3bf-e837-4958-83a8-9b59a89482a4 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:55:01.649437 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-82e2c3bf-e837-4958-83a8-9b59a89482a4 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:55:01.649785 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-82e2c3bf-e837-4958-83a8-9b59a89482a4 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:55:01.658895 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.compute.server_external_events [req-b25f6df7-3f06-438c-a0cb-f49df8901e22 req-c05d0de0-2149-41de-ba03-f5facedd6aca service nova] Creating event network-changed:18b93783-3039-4fd9-b75c-752a99040bff for instance 82ec9293-050f-48f2-b0fd-e563145c6cb3 on hv-cinder-79760 Jul 05 20:55:01.659989 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [req-b25f6df7-3f06-438c-a0cb-f49df8901e22 req-c05d0de0-2149-41de-ba03-f5facedd6aca service nova] Acquired lock "compute-rpcapi-router" {{(pid=117628) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 05 20:55:01.661165 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-c5a47e3d-e910-45b3-b328-7d4951a3a037 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:55:01.661595 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-c5a47e3d-e910-45b3-b328-7d4951a3a037 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:55:01.662389 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-c5a47e3d-e910-45b3-b328-7d4951a3a037 None None] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:55:01.662814 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-c5a47e3d-e910-45b3-b328-7d4951a3a037 None None] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:55:01.671716 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.compute.rpcapi [None req-c5a47e3d-e910-45b3-b328-7d4951a3a037 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 05 20:55:01.672621 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-c5a47e3d-e910-45b3-b328-7d4951a3a037 None None] Releasing lock "compute-rpcapi-router" {{(pid=117628) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 05 20:55:01.692479 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-c5a47e3d-e910-45b3-b328-7d4951a3a037 None None] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066442 Jul 05 20:55:01.693546 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 50/93] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 5 20:55:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 20:55:01.789018 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-82e2c3bf-e837-4958-83a8-9b59a89482a4 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd152763a64794301b21587ab2b395bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc6d47f96d17471d94367bc8f8a3e3f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:55:01.798517 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-82e2c3bf-e837-4958-83a8-9b59a89482a4 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] 10.222.0.20 "GET /compute/v2.1/servers/82ec9293-050f-48f2-b0fd-e563145c6cb3" status: 200 len: 1321 microversion: 2.1 time: 0.159690 Jul 05 20:55:01.798517 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 44/94] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:55:01 2022] GET /compute/v2.1/servers/82ec9293-050f-48f2-b0fd-e563145c6cb3 => generated 1321 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 20:55:01.924372 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-305938e8-b2c6-4d19-a500-1a9a6f6cf321 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:55:01.925709 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-305938e8-b2c6-4d19-a500-1a9a6f6cf321 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] [instance: 52848078-62a1-484f-813c-7b3352cb3851] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:55:01.932033 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-305938e8-b2c6-4d19-a500-1a9a6f6cf321 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:55:01.932485 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-305938e8-b2c6-4d19-a500-1a9a6f6cf321 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:55:01.933469 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-305938e8-b2c6-4d19-a500-1a9a6f6cf321 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:55:01.934061 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-305938e8-b2c6-4d19-a500-1a9a6f6cf321 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:55:02.077688 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-305938e8-b2c6-4d19-a500-1a9a6f6cf321 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:55:02.085530 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-305938e8-b2c6-4d19-a500-1a9a6f6cf321 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:55:02.087012 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-305938e8-b2c6-4d19-a500-1a9a6f6cf321 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:55:02.088102 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-305938e8-b2c6-4d19-a500-1a9a6f6cf321 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] 10.222.0.20 "GET /compute/v2.1/servers/52848078-62a1-484f-813c-7b3352cb3851" status: 200 len: 1402 microversion: 2.20 time: 0.167911 Jul 05 20:55:02.088660 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 51/95] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 5 20:55:01 2022] GET /compute/v2.1/servers/52848078-62a1-484f-813c-7b3352cb3851 => generated 1402 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 20:55:02.606142 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-f37a4f2a-6652-4d7d-96e6-3dc263c58e7c tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:55:02.606903 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-f37a4f2a-6652-4d7d-96e6-3dc263c58e7c tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] [instance: f236112c-4649-478b-a626-b84f8ff1bfe9] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:55:02.613725 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-f37a4f2a-6652-4d7d-96e6-3dc263c58e7c tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:55:02.614270 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-f37a4f2a-6652-4d7d-96e6-3dc263c58e7c tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:55:02.615328 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-f37a4f2a-6652-4d7d-96e6-3dc263c58e7c tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:55:02.615938 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-f37a4f2a-6652-4d7d-96e6-3dc263c58e7c tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:55:02.813757 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-57100203-e9b1-423a-991b-22821dc5f6c5 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:55:02.814620 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-57100203-e9b1-423a-991b-22821dc5f6c5 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] [instance: 82ec9293-050f-48f2-b0fd-e563145c6cb3] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:55:02.822498 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-57100203-e9b1-423a-991b-22821dc5f6c5 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:55:02.822950 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-57100203-e9b1-423a-991b-22821dc5f6c5 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:55:02.823863 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-57100203-e9b1-423a-991b-22821dc5f6c5 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:55:02.824251 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-57100203-e9b1-423a-991b-22821dc5f6c5 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:55:03.017286 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-f37a4f2a-6652-4d7d-96e6-3dc263c58e7c tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eac41ce3f04450b840cff305ec1a5ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47e1ad014d542f98f6b24c8a504d166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:55:03.041181 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-f37a4f2a-6652-4d7d-96e6-3dc263c58e7c tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] 10.222.0.20 "GET /compute/v2.1/servers/f236112c-4649-478b-a626-b84f8ff1bfe9" status: 200 len: 1363 microversion: 2.1 time: 0.431118 Jul 05 20:55:03.044340 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 45/96] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:55:02 2022] GET /compute/v2.1/servers/f236112c-4649-478b-a626-b84f8ff1bfe9 => generated 1363 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 20:55:03.100259 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-57100203-e9b1-423a-991b-22821dc5f6c5 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd152763a64794301b21587ab2b395bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc6d47f96d17471d94367bc8f8a3e3f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:55:03.110660 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-e4da8ae9-b6d2-4a31-8b98-4fbecbd049e3 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:55:03.110660 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-e4da8ae9-b6d2-4a31-8b98-4fbecbd049e3 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] [instance: 52848078-62a1-484f-813c-7b3352cb3851] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:55:03.112882 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-57100203-e9b1-423a-991b-22821dc5f6c5 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] 10.222.0.20 "GET /compute/v2.1/servers/82ec9293-050f-48f2-b0fd-e563145c6cb3" status: 200 len: 1321 microversion: 2.1 time: 0.299773 Jul 05 20:55:03.122706 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-e4da8ae9-b6d2-4a31-8b98-4fbecbd049e3 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:55:03.123160 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-e4da8ae9-b6d2-4a31-8b98-4fbecbd049e3 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:55:03.123938 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-e4da8ae9-b6d2-4a31-8b98-4fbecbd049e3 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:55:03.124373 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-e4da8ae9-b6d2-4a31-8b98-4fbecbd049e3 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:55:03.126681 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 52/97] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:55:02 2022] GET /compute/v2.1/servers/82ec9293-050f-48f2-b0fd-e563145c6cb3 => generated 1321 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 20:55:03.302661 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-e4da8ae9-b6d2-4a31-8b98-4fbecbd049e3 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:55:03.310959 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-e4da8ae9-b6d2-4a31-8b98-4fbecbd049e3 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:55:03.312789 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-e4da8ae9-b6d2-4a31-8b98-4fbecbd049e3 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:55:03.314153 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-e4da8ae9-b6d2-4a31-8b98-4fbecbd049e3 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] 10.222.0.20 "GET /compute/v2.1/servers/52848078-62a1-484f-813c-7b3352cb3851" status: 200 len: 1402 microversion: 2.20 time: 0.211238 Jul 05 20:55:03.315264 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 46/98] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 5 20:55:03 2022] GET /compute/v2.1/servers/52848078-62a1-484f-813c-7b3352cb3851 => generated 1402 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 20:55:03.691322 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [req-c8e7f4c1-2f02-4c87-9595-e11b9c87c4b1 req-9f89d451-bf42-4305-a75d-212eaaa211f6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "52848078-62a1-484f-813c-7b3352cb3851", "tag": "1f543410-d13c-44b8-9d38-5417d712191c"}]} {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 20:55:03.706686 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [req-c8e7f4c1-2f02-4c87-9595-e11b9c87c4b1 req-9f89d451-bf42-4305-a75d-212eaaa211f6 service nova] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:55:03.707333 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [req-c8e7f4c1-2f02-4c87-9595-e11b9c87c4b1 req-9f89d451-bf42-4305-a75d-212eaaa211f6 service nova] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:55:03.714606 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG dbcounter [-] [117628] Writing DB stats nova_cell1:SELECT=100 {{(pid=117628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:55:03.730907 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.compute.server_external_events [req-c8e7f4c1-2f02-4c87-9595-e11b9c87c4b1 req-9f89d451-bf42-4305-a75d-212eaaa211f6 service nova] Creating event network-changed:1f543410-d13c-44b8-9d38-5417d712191c for instance 52848078-62a1-484f-813c-7b3352cb3851 on hv-cinder-79760 Jul 05 20:55:03.744854 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-d5aadae1-a333-43b2-8697-223912886ef7 tempest-DeleteServersTestJSON-389510094 tempest-DeleteServersTestJSON-389510094-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c93458ab-12e4-47fa-99d5-5be715d45c17"}} {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 20:55:03.746212 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [req-c8e7f4c1-2f02-4c87-9595-e11b9c87c4b1 req-9f89d451-bf42-4305-a75d-212eaaa211f6 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059264 Jul 05 20:55:03.747280 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 53/99] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 5 20:55:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 20:55:03.748293 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-d5aadae1-a333-43b2-8697-223912886ef7 tempest-DeleteServersTestJSON-389510094 tempest-DeleteServersTestJSON-389510094-project] [instance: 1159954e-7c69-48d8-b051-5a7b1108da69] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:55:03.769630 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-d5aadae1-a333-43b2-8697-223912886ef7 tempest-DeleteServersTestJSON-389510094 tempest-DeleteServersTestJSON-389510094-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:55:03.769991 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-d5aadae1-a333-43b2-8697-223912886ef7 tempest-DeleteServersTestJSON-389510094 tempest-DeleteServersTestJSON-389510094-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:55:03.770893 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-d5aadae1-a333-43b2-8697-223912886ef7 tempest-DeleteServersTestJSON-389510094 tempest-DeleteServersTestJSON-389510094-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:55:03.771338 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-d5aadae1-a333-43b2-8697-223912886ef7 tempest-DeleteServersTestJSON-389510094 tempest-DeleteServersTestJSON-389510094-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:55:04.061805 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-0ce0e887-368c-4f82-9744-39e93a52e6d5 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:55:04.062724 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-0ce0e887-368c-4f82-9744-39e93a52e6d5 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] [instance: f236112c-4649-478b-a626-b84f8ff1bfe9] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:55:04.070537 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-0ce0e887-368c-4f82-9744-39e93a52e6d5 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:55:04.071006 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-0ce0e887-368c-4f82-9744-39e93a52e6d5 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:55:04.071845 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-0ce0e887-368c-4f82-9744-39e93a52e6d5 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:55:04.072431 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-0ce0e887-368c-4f82-9744-39e93a52e6d5 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:55:04.269482 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-0ce0e887-368c-4f82-9744-39e93a52e6d5 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eac41ce3f04450b840cff305ec1a5ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47e1ad014d542f98f6b24c8a504d166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:55:04.277327 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-0ce0e887-368c-4f82-9744-39e93a52e6d5 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] 10.222.0.20 "GET /compute/v2.1/servers/f236112c-4649-478b-a626-b84f8ff1bfe9" status: 200 len: 1363 microversion: 2.1 time: 0.219693 Jul 05 20:55:04.277905 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 54/100] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:55:04 2022] GET /compute/v2.1/servers/f236112c-4649-478b-a626-b84f8ff1bfe9 => generated 1363 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 20:55:04.282535 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-6a2e9de9-bbd8-4ecd-b4c9-4dfde03a35e8 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:55:04.283133 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-6a2e9de9-bbd8-4ecd-b4c9-4dfde03a35e8 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] [instance: 82ec9293-050f-48f2-b0fd-e563145c6cb3] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:55:04.289799 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-6a2e9de9-bbd8-4ecd-b4c9-4dfde03a35e8 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:55:04.290244 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-6a2e9de9-bbd8-4ecd-b4c9-4dfde03a35e8 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:55:04.291007 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-6a2e9de9-bbd8-4ecd-b4c9-4dfde03a35e8 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:55:04.291444 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-6a2e9de9-bbd8-4ecd-b4c9-4dfde03a35e8 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:55:04.428734 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-6a2e9de9-bbd8-4ecd-b4c9-4dfde03a35e8 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd152763a64794301b21587ab2b395bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc6d47f96d17471d94367bc8f8a3e3f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:55:04.436172 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-6a2e9de9-bbd8-4ecd-b4c9-4dfde03a35e8 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] 10.222.0.20 "GET /compute/v2.1/servers/82ec9293-050f-48f2-b0fd-e563145c6cb3" status: 200 len: 1321 microversion: 2.1 time: 0.157317 Jul 05 20:55:04.436738 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 55/101] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:55:04 2022] GET /compute/v2.1/servers/82ec9293-050f-48f2-b0fd-e563145c6cb3 => generated 1321 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 20:55:04.441182 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-b1425c4c-69ca-4b48-9787-9bda0b45a437 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:55:04.441775 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-b1425c4c-69ca-4b48-9787-9bda0b45a437 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] [instance: 52848078-62a1-484f-813c-7b3352cb3851] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:55:04.447635 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-b1425c4c-69ca-4b48-9787-9bda0b45a437 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:55:04.448072 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-b1425c4c-69ca-4b48-9787-9bda0b45a437 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:55:04.448817 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-b1425c4c-69ca-4b48-9787-9bda0b45a437 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:55:04.449271 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-b1425c4c-69ca-4b48-9787-9bda0b45a437 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:55:04.585835 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-b1425c4c-69ca-4b48-9787-9bda0b45a437 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:55:04.594135 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-b1425c4c-69ca-4b48-9787-9bda0b45a437 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:55:04.595846 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-b1425c4c-69ca-4b48-9787-9bda0b45a437 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:55:04.597564 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-b1425c4c-69ca-4b48-9787-9bda0b45a437 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] 10.222.0.20 "GET /compute/v2.1/servers/52848078-62a1-484f-813c-7b3352cb3851" status: 200 len: 1402 microversion: 2.20 time: 0.159297 Jul 05 20:55:04.598126 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 56/102] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 5 20:55:04 2022] GET /compute/v2.1/servers/52848078-62a1-484f-813c-7b3352cb3851 => generated 1402 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 20:55:05.294787 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-c7de5882-84f0-4ad2-ada9-69149d51e921 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:55:05.297280 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-c7de5882-84f0-4ad2-ada9-69149d51e921 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] [instance: f236112c-4649-478b-a626-b84f8ff1bfe9] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:55:05.305307 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-c7de5882-84f0-4ad2-ada9-69149d51e921 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:55:05.305858 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-c7de5882-84f0-4ad2-ada9-69149d51e921 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:55:05.306731 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-c7de5882-84f0-4ad2-ada9-69149d51e921 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:55:05.307176 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-c7de5882-84f0-4ad2-ada9-69149d51e921 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:55:05.313785 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG dbcounter [-] [117627] Writing DB stats nova_cell0:SELECT=6 {{(pid=117627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:55:05.360232 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG dbcounter [-] [117627] Writing DB stats nova_cell0:SELECT=16 {{(pid=117627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:55:05.452878 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-c7de5882-84f0-4ad2-ada9-69149d51e921 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eac41ce3f04450b840cff305ec1a5ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47e1ad014d542f98f6b24c8a504d166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:55:05.460687 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-c7de5882-84f0-4ad2-ada9-69149d51e921 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] 10.222.0.20 "GET /compute/v2.1/servers/f236112c-4649-478b-a626-b84f8ff1bfe9" status: 200 len: 1363 microversion: 2.1 time: 0.169782 Jul 05 20:55:05.461296 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 57/103] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:55:05 2022] GET /compute/v2.1/servers/f236112c-4649-478b-a626-b84f8ff1bfe9 => generated 1363 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 20:55:05.465652 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-8bd2d5dd-b94b-4ff9-99e4-faf8e28a45e4 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:55:05.466257 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-8bd2d5dd-b94b-4ff9-99e4-faf8e28a45e4 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] [instance: 82ec9293-050f-48f2-b0fd-e563145c6cb3] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:55:05.472530 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-8bd2d5dd-b94b-4ff9-99e4-faf8e28a45e4 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:55:05.473195 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-8bd2d5dd-b94b-4ff9-99e4-faf8e28a45e4 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:55:05.474271 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-8bd2d5dd-b94b-4ff9-99e4-faf8e28a45e4 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:55:05.474840 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-8bd2d5dd-b94b-4ff9-99e4-faf8e28a45e4 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:55:05.611699 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-8bd2d5dd-b94b-4ff9-99e4-faf8e28a45e4 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd152763a64794301b21587ab2b395bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc6d47f96d17471d94367bc8f8a3e3f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:55:05.620248 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-8bd2d5dd-b94b-4ff9-99e4-faf8e28a45e4 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] 10.222.0.20 "GET /compute/v2.1/servers/82ec9293-050f-48f2-b0fd-e563145c6cb3" status: 200 len: 1321 microversion: 2.1 time: 0.157939 Jul 05 20:55:05.620845 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 58/104] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:55:05 2022] GET /compute/v2.1/servers/82ec9293-050f-48f2-b0fd-e563145c6cb3 => generated 1321 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 20:55:05.625558 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-b8f12f61-12cd-42ae-81cf-d97c152e7046 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:55:05.626318 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-b8f12f61-12cd-42ae-81cf-d97c152e7046 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] [instance: 52848078-62a1-484f-813c-7b3352cb3851] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:55:05.632171 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-b8f12f61-12cd-42ae-81cf-d97c152e7046 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:55:05.632564 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-b8f12f61-12cd-42ae-81cf-d97c152e7046 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:55:05.633362 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-b8f12f61-12cd-42ae-81cf-d97c152e7046 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:55:05.633792 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-b8f12f61-12cd-42ae-81cf-d97c152e7046 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:55:05.780398 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-b8f12f61-12cd-42ae-81cf-d97c152e7046 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:55:05.788474 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-b8f12f61-12cd-42ae-81cf-d97c152e7046 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:55:05.790099 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-b8f12f61-12cd-42ae-81cf-d97c152e7046 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:55:05.791286 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-b8f12f61-12cd-42ae-81cf-d97c152e7046 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] 10.222.0.20 "GET /compute/v2.1/servers/52848078-62a1-484f-813c-7b3352cb3851" status: 200 len: 1402 microversion: 2.20 time: 0.169297 Jul 05 20:55:05.803021 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 59/105] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 5 20:55:05 2022] GET /compute/v2.1/servers/52848078-62a1-484f-813c-7b3352cb3851 => generated 1402 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 20:55:06.481557 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-76e53beb-e208-4ca6-93ff-03bbae0d8995 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:55:06.482373 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-76e53beb-e208-4ca6-93ff-03bbae0d8995 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] [instance: f236112c-4649-478b-a626-b84f8ff1bfe9] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:55:06.485366 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG dbcounter [-] [117628] Writing DB stats nova_cell0:SELECT=20 {{(pid=117628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:55:06.491690 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-76e53beb-e208-4ca6-93ff-03bbae0d8995 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:55:06.492133 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-76e53beb-e208-4ca6-93ff-03bbae0d8995 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:55:06.493091 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-76e53beb-e208-4ca6-93ff-03bbae0d8995 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:55:06.493733 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-76e53beb-e208-4ca6-93ff-03bbae0d8995 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:55:06.806271 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-76e53beb-e208-4ca6-93ff-03bbae0d8995 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eac41ce3f04450b840cff305ec1a5ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47e1ad014d542f98f6b24c8a504d166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:55:06.819882 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-76e53beb-e208-4ca6-93ff-03bbae0d8995 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] 10.222.0.20 "GET /compute/v2.1/servers/f236112c-4649-478b-a626-b84f8ff1bfe9" status: 200 len: 1363 microversion: 2.1 time: 0.343707 Jul 05 20:55:06.820437 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 60/106] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:55:06 2022] GET /compute/v2.1/servers/f236112c-4649-478b-a626-b84f8ff1bfe9 => generated 1363 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 20:55:06.837792 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-8e59c030-a113-4188-b117-17c17cd8bc00 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:55:06.838622 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-8e59c030-a113-4188-b117-17c17cd8bc00 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] [instance: 82ec9293-050f-48f2-b0fd-e563145c6cb3] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:55:06.845333 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-8e59c030-a113-4188-b117-17c17cd8bc00 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:55:06.846037 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-8e59c030-a113-4188-b117-17c17cd8bc00 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:55:06.859269 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-8e59c030-a113-4188-b117-17c17cd8bc00 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:55:06.866126 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-d5aadae1-a333-43b2-8697-223912886ef7 tempest-DeleteServersTestJSON-389510094 tempest-DeleteServersTestJSON-389510094-project] 10.222.0.20 "POST /compute/v2.1/servers/1159954e-7c69-48d8-b051-5a7b1108da69/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.126635 Jul 05 20:55:06.867562 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 47/107] 10.222.0.20 () {60 vars in 1322 bytes} [Tue Jul 5 20:55:03 2022] POST /compute/v2.1/servers/1159954e-7c69-48d8-b051-5a7b1108da69/os-volume_attachments => generated 194 bytes in 3130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 05 20:55:06.874135 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-8e59c030-a113-4188-b117-17c17cd8bc00 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:55:06.892973 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-730aea3d-5e92-4824-8c23-ecec11d1f3f3 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:55:06.894284 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-730aea3d-5e92-4824-8c23-ecec11d1f3f3 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] [instance: 52848078-62a1-484f-813c-7b3352cb3851] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:55:06.903844 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-730aea3d-5e92-4824-8c23-ecec11d1f3f3 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:55:06.904613 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-730aea3d-5e92-4824-8c23-ecec11d1f3f3 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:55:06.906206 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-730aea3d-5e92-4824-8c23-ecec11d1f3f3 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:55:06.906896 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-730aea3d-5e92-4824-8c23-ecec11d1f3f3 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:55:07.219860 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-730aea3d-5e92-4824-8c23-ecec11d1f3f3 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:55:07.226111 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-8e59c030-a113-4188-b117-17c17cd8bc00 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd152763a64794301b21587ab2b395bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc6d47f96d17471d94367bc8f8a3e3f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:55:07.233321 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-730aea3d-5e92-4824-8c23-ecec11d1f3f3 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:55:07.235540 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-730aea3d-5e92-4824-8c23-ecec11d1f3f3 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:55:07.237647 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-730aea3d-5e92-4824-8c23-ecec11d1f3f3 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] 10.222.0.20 "GET /compute/v2.1/servers/52848078-62a1-484f-813c-7b3352cb3851" status: 200 len: 1402 microversion: 2.20 time: 0.368032 Jul 05 20:55:07.238246 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 48/108] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 5 20:55:06 2022] GET /compute/v2.1/servers/52848078-62a1-484f-813c-7b3352cb3851 => generated 1402 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 20:55:07.239832 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-8e59c030-a113-4188-b117-17c17cd8bc00 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] 10.222.0.20 "GET /compute/v2.1/servers/82ec9293-050f-48f2-b0fd-e563145c6cb3" status: 200 len: 1321 microversion: 2.1 time: 0.405675 Jul 05 20:55:07.242258 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 61/109] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:55:06 2022] GET /compute/v2.1/servers/82ec9293-050f-48f2-b0fd-e563145c6cb3 => generated 1321 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 20:55:07.838969 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-60932d46-b18c-44ff-b694-012efd81843b tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:55:07.839838 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-60932d46-b18c-44ff-b694-012efd81843b tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] [instance: f236112c-4649-478b-a626-b84f8ff1bfe9] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:55:07.847733 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-60932d46-b18c-44ff-b694-012efd81843b tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:55:07.848409 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-60932d46-b18c-44ff-b694-012efd81843b tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:55:07.849360 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-60932d46-b18c-44ff-b694-012efd81843b tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:55:07.849937 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-60932d46-b18c-44ff-b694-012efd81843b tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:55:08.021654 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-60932d46-b18c-44ff-b694-012efd81843b tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eac41ce3f04450b840cff305ec1a5ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47e1ad014d542f98f6b24c8a504d166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:55:08.030164 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-60932d46-b18c-44ff-b694-012efd81843b tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] 10.222.0.20 "GET /compute/v2.1/servers/f236112c-4649-478b-a626-b84f8ff1bfe9" status: 200 len: 1363 microversion: 2.1 time: 0.196679 Jul 05 20:55:08.030741 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 49/110] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:55:07 2022] GET /compute/v2.1/servers/f236112c-4649-478b-a626-b84f8ff1bfe9 => generated 1363 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 20:55:08.258039 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-932baf59-ed89-470d-8f6b-827868606f08 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:55:08.258633 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-a81d406c-29f3-4852-a0ae-1953a53a9fd0 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:55:08.259580 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-932baf59-ed89-470d-8f6b-827868606f08 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] [instance: 82ec9293-050f-48f2-b0fd-e563145c6cb3] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:55:08.259754 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-a81d406c-29f3-4852-a0ae-1953a53a9fd0 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] [instance: 52848078-62a1-484f-813c-7b3352cb3851] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:55:08.269695 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-932baf59-ed89-470d-8f6b-827868606f08 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:55:08.271533 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-932baf59-ed89-470d-8f6b-827868606f08 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:55:08.273161 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-932baf59-ed89-470d-8f6b-827868606f08 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:55:08.273875 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-a81d406c-29f3-4852-a0ae-1953a53a9fd0 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:55:08.274983 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-a81d406c-29f3-4852-a0ae-1953a53a9fd0 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:55:08.275623 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-932baf59-ed89-470d-8f6b-827868606f08 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:55:08.278675 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-a81d406c-29f3-4852-a0ae-1953a53a9fd0 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:55:08.279367 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-a81d406c-29f3-4852-a0ae-1953a53a9fd0 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:55:08.741605 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-a81d406c-29f3-4852-a0ae-1953a53a9fd0 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:55:08.758951 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-a81d406c-29f3-4852-a0ae-1953a53a9fd0 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:55:08.764153 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-a81d406c-29f3-4852-a0ae-1953a53a9fd0 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:55:08.765347 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-a81d406c-29f3-4852-a0ae-1953a53a9fd0 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] 10.222.0.20 "GET /compute/v2.1/servers/52848078-62a1-484f-813c-7b3352cb3851" status: 200 len: 1402 microversion: 2.20 time: 0.513639 Jul 05 20:55:08.780228 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 62/111] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 5 20:55:08 2022] GET /compute/v2.1/servers/52848078-62a1-484f-813c-7b3352cb3851 => generated 1402 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 20:55:08.830734 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-932baf59-ed89-470d-8f6b-827868606f08 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd152763a64794301b21587ab2b395bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc6d47f96d17471d94367bc8f8a3e3f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:55:08.841366 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-932baf59-ed89-470d-8f6b-827868606f08 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] 10.222.0.20 "GET /compute/v2.1/servers/82ec9293-050f-48f2-b0fd-e563145c6cb3" status: 200 len: 1321 microversion: 2.1 time: 0.587003 Jul 05 20:55:08.841980 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 50/112] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:55:08 2022] GET /compute/v2.1/servers/82ec9293-050f-48f2-b0fd-e563145c6cb3 => generated 1321 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 20:55:09.050772 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-eac6cec8-19ef-4a1c-9415-51ad03dbc4f3 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:55:09.052067 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-eac6cec8-19ef-4a1c-9415-51ad03dbc4f3 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] [instance: f236112c-4649-478b-a626-b84f8ff1bfe9] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:55:09.059710 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-eac6cec8-19ef-4a1c-9415-51ad03dbc4f3 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:55:09.060519 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-eac6cec8-19ef-4a1c-9415-51ad03dbc4f3 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:55:09.061462 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-eac6cec8-19ef-4a1c-9415-51ad03dbc4f3 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:55:09.062043 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-eac6cec8-19ef-4a1c-9415-51ad03dbc4f3 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:55:09.710026 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-eac6cec8-19ef-4a1c-9415-51ad03dbc4f3 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eac41ce3f04450b840cff305ec1a5ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47e1ad014d542f98f6b24c8a504d166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:55:09.725153 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-eac6cec8-19ef-4a1c-9415-51ad03dbc4f3 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] 10.222.0.20 "GET /compute/v2.1/servers/f236112c-4649-478b-a626-b84f8ff1bfe9" status: 200 len: 1363 microversion: 2.1 time: 0.678643 Jul 05 20:55:09.727078 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 63/113] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:55:09 2022] GET /compute/v2.1/servers/f236112c-4649-478b-a626-b84f8ff1bfe9 => generated 1363 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 20:55:09.784244 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-cc6eba6b-e939-41d0-a576-091f74c77d49 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:55:09.785487 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-cc6eba6b-e939-41d0-a576-091f74c77d49 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] [instance: 52848078-62a1-484f-813c-7b3352cb3851] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:55:09.793881 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-cc6eba6b-e939-41d0-a576-091f74c77d49 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:55:09.798366 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-cc6eba6b-e939-41d0-a576-091f74c77d49 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:55:09.799370 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-cc6eba6b-e939-41d0-a576-091f74c77d49 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:55:09.805097 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-cc6eba6b-e939-41d0-a576-091f74c77d49 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:55:09.809992 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG dbcounter [-] [117627] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:55:09.869596 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-9b97336b-029e-468e-a547-033e1e41dd97 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:55:09.871316 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-9b97336b-029e-468e-a547-033e1e41dd97 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] [instance: 82ec9293-050f-48f2-b0fd-e563145c6cb3] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:55:09.896496 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-9b97336b-029e-468e-a547-033e1e41dd97 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:55:09.898804 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-9b97336b-029e-468e-a547-033e1e41dd97 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:55:09.903924 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-9b97336b-029e-468e-a547-033e1e41dd97 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:55:09.905508 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-9b97336b-029e-468e-a547-033e1e41dd97 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:55:10.104108 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-cc6eba6b-e939-41d0-a576-091f74c77d49 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:55:10.113591 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-cc6eba6b-e939-41d0-a576-091f74c77d49 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:55:10.115095 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-cc6eba6b-e939-41d0-a576-091f74c77d49 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:55:10.124777 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-cc6eba6b-e939-41d0-a576-091f74c77d49 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] 10.222.0.20 "GET /compute/v2.1/servers/52848078-62a1-484f-813c-7b3352cb3851" status: 200 len: 1402 microversion: 2.20 time: 0.339512 Jul 05 20:55:10.125722 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 51/114] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 5 20:55:09 2022] GET /compute/v2.1/servers/52848078-62a1-484f-813c-7b3352cb3851 => generated 1402 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 20:55:10.204506 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-9b97336b-029e-468e-a547-033e1e41dd97 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd152763a64794301b21587ab2b395bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc6d47f96d17471d94367bc8f8a3e3f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:55:10.214972 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-9b97336b-029e-468e-a547-033e1e41dd97 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] 10.222.0.20 "GET /compute/v2.1/servers/82ec9293-050f-48f2-b0fd-e563145c6cb3" status: 200 len: 1321 microversion: 2.1 time: 0.358320 Jul 05 20:55:10.227886 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 64/115] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:55:09 2022] GET /compute/v2.1/servers/82ec9293-050f-48f2-b0fd-e563145c6cb3 => generated 1321 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 20:55:10.743953 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-5a645214-56a2-4e10-a804-2ce2f65ee448 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:55:10.744562 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-5a645214-56a2-4e10-a804-2ce2f65ee448 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] [instance: f236112c-4649-478b-a626-b84f8ff1bfe9] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:55:10.750953 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-5a645214-56a2-4e10-a804-2ce2f65ee448 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:55:10.751400 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-5a645214-56a2-4e10-a804-2ce2f65ee448 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:55:10.752161 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-5a645214-56a2-4e10-a804-2ce2f65ee448 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:55:10.753435 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-5a645214-56a2-4e10-a804-2ce2f65ee448 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:55:11.074077 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-5a645214-56a2-4e10-a804-2ce2f65ee448 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eac41ce3f04450b840cff305ec1a5ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47e1ad014d542f98f6b24c8a504d166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:55:11.084305 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-5a645214-56a2-4e10-a804-2ce2f65ee448 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] 10.222.0.20 "GET /compute/v2.1/servers/f236112c-4649-478b-a626-b84f8ff1bfe9" status: 200 len: 1363 microversion: 2.1 time: 0.344103 Jul 05 20:55:11.085646 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 52/116] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:55:10 2022] GET /compute/v2.1/servers/f236112c-4649-478b-a626-b84f8ff1bfe9 => generated 1363 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 20:55:11.160494 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-be2e3a6e-1890-4b72-a329-fb739c9c33d3 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:55:11.161760 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-be2e3a6e-1890-4b72-a329-fb739c9c33d3 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] [instance: 52848078-62a1-484f-813c-7b3352cb3851] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:55:11.170088 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-be2e3a6e-1890-4b72-a329-fb739c9c33d3 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:55:11.173810 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-be2e3a6e-1890-4b72-a329-fb739c9c33d3 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:55:11.175417 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-be2e3a6e-1890-4b72-a329-fb739c9c33d3 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:55:11.176091 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-be2e3a6e-1890-4b72-a329-fb739c9c33d3 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:55:11.234722 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-a76547ab-7496-4ac0-880a-b9b50335d63e tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:55:11.235811 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-a76547ab-7496-4ac0-880a-b9b50335d63e tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] [instance: 82ec9293-050f-48f2-b0fd-e563145c6cb3] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:55:11.249325 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-a76547ab-7496-4ac0-880a-b9b50335d63e tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:55:11.251985 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-a76547ab-7496-4ac0-880a-b9b50335d63e tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:55:11.254521 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-a76547ab-7496-4ac0-880a-b9b50335d63e tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:55:11.255195 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-a76547ab-7496-4ac0-880a-b9b50335d63e tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:55:11.435252 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-be2e3a6e-1890-4b72-a329-fb739c9c33d3 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:55:11.445718 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-be2e3a6e-1890-4b72-a329-fb739c9c33d3 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:55:11.447225 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-be2e3a6e-1890-4b72-a329-fb739c9c33d3 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:55:11.448587 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-be2e3a6e-1890-4b72-a329-fb739c9c33d3 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] 10.222.0.20 "GET /compute/v2.1/servers/52848078-62a1-484f-813c-7b3352cb3851" status: 200 len: 1402 microversion: 2.20 time: 0.305501 Jul 05 20:55:11.448893 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 65/117] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 5 20:55:11 2022] GET /compute/v2.1/servers/52848078-62a1-484f-813c-7b3352cb3851 => generated 1402 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 05 20:55:11.479312 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-a76547ab-7496-4ac0-880a-b9b50335d63e tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd152763a64794301b21587ab2b395bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc6d47f96d17471d94367bc8f8a3e3f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:55:11.489517 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-a76547ab-7496-4ac0-880a-b9b50335d63e tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] 10.222.0.20 "GET /compute/v2.1/servers/82ec9293-050f-48f2-b0fd-e563145c6cb3" status: 200 len: 1321 microversion: 2.1 time: 0.258613 Jul 05 20:55:11.491254 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 53/118] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:55:11 2022] GET /compute/v2.1/servers/82ec9293-050f-48f2-b0fd-e563145c6cb3 => generated 1321 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 20:55:12.101979 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-2e565b04-85df-4db2-9a75-4b31f71af96d tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:55:12.102599 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-2e565b04-85df-4db2-9a75-4b31f71af96d tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] [instance: f236112c-4649-478b-a626-b84f8ff1bfe9] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:55:12.116892 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG dbcounter [-] [117628] Writing DB stats nova_cell0:SELECT=2 {{(pid=117628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:55:12.119096 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-2e565b04-85df-4db2-9a75-4b31f71af96d tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:55:12.119549 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-2e565b04-85df-4db2-9a75-4b31f71af96d tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:55:12.120428 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-2e565b04-85df-4db2-9a75-4b31f71af96d tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:55:12.120899 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-2e565b04-85df-4db2-9a75-4b31f71af96d tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:55:12.319838 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-2e565b04-85df-4db2-9a75-4b31f71af96d tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eac41ce3f04450b840cff305ec1a5ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47e1ad014d542f98f6b24c8a504d166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:55:12.329285 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-2e565b04-85df-4db2-9a75-4b31f71af96d tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] 10.222.0.20 "GET /compute/v2.1/servers/f236112c-4649-478b-a626-b84f8ff1bfe9" status: 200 len: 1363 microversion: 2.1 time: 0.231400 Jul 05 20:55:12.333379 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 66/119] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:55:12 2022] GET /compute/v2.1/servers/f236112c-4649-478b-a626-b84f8ff1bfe9 => generated 1363 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 20:55:12.467138 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-1753610a-ce5f-4663-a75a-e2b5a0019577 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:55:12.468910 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-1753610a-ce5f-4663-a75a-e2b5a0019577 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] [instance: 52848078-62a1-484f-813c-7b3352cb3851] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:55:12.480547 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-1753610a-ce5f-4663-a75a-e2b5a0019577 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:55:12.481607 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-1753610a-ce5f-4663-a75a-e2b5a0019577 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:55:12.483612 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-1753610a-ce5f-4663-a75a-e2b5a0019577 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:55:12.484395 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-1753610a-ce5f-4663-a75a-e2b5a0019577 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:55:12.509512 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-aa9aaf10-114b-4406-8e13-2cb7af398a99 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:55:12.510519 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-aa9aaf10-114b-4406-8e13-2cb7af398a99 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] [instance: 82ec9293-050f-48f2-b0fd-e563145c6cb3] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:55:12.524466 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-aa9aaf10-114b-4406-8e13-2cb7af398a99 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:55:12.525240 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-aa9aaf10-114b-4406-8e13-2cb7af398a99 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:55:12.526204 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-aa9aaf10-114b-4406-8e13-2cb7af398a99 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:55:12.527159 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-aa9aaf10-114b-4406-8e13-2cb7af398a99 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:55:12.727301 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-1753610a-ce5f-4663-a75a-e2b5a0019577 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:55:12.739641 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-1753610a-ce5f-4663-a75a-e2b5a0019577 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:55:12.750736 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-1753610a-ce5f-4663-a75a-e2b5a0019577 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:55:12.752496 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-1753610a-ce5f-4663-a75a-e2b5a0019577 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] 10.222.0.20 "GET /compute/v2.1/servers/52848078-62a1-484f-813c-7b3352cb3851" status: 200 len: 1402 microversion: 2.20 time: 0.289178 Jul 05 20:55:12.753676 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 54/120] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 5 20:55:12 2022] GET /compute/v2.1/servers/52848078-62a1-484f-813c-7b3352cb3851 => generated 1402 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 20:55:12.758697 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [req-04aec830-c8de-48d0-a897-49d98ee82c10 req-a9fb4f7d-dc01-4442-8cc7-91f7c152333f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3aeae5c-d73d-4fb3-afa0-ee691e6a4fd4", "name": "network-vif-plugged", "status": "completed", "tag": "9d4d8d62-90d7-4b09-8e51-523c69e6c012"}]} {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 20:55:12.783044 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [req-04aec830-c8de-48d0-a897-49d98ee82c10 req-a9fb4f7d-dc01-4442-8cc7-91f7c152333f service nova] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:55:12.785611 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [req-04aec830-c8de-48d0-a897-49d98ee82c10 req-a9fb4f7d-dc01-4442-8cc7-91f7c152333f service nova] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:55:12.808015 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.compute.server_external_events [req-04aec830-c8de-48d0-a897-49d98ee82c10 req-a9fb4f7d-dc01-4442-8cc7-91f7c152333f service nova] Creating event network-vif-plugged:9d4d8d62-90d7-4b09-8e51-523c69e6c012 for instance a3aeae5c-d73d-4fb3-afa0-ee691e6a4fd4 on hv-cinder-79760 Jul 05 20:55:12.817410 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [req-04aec830-c8de-48d0-a897-49d98ee82c10 req-a9fb4f7d-dc01-4442-8cc7-91f7c152333f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061579 Jul 05 20:55:12.818768 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 55/121] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 5 20:55:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 20:55:12.836313 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-aa9aaf10-114b-4406-8e13-2cb7af398a99 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd152763a64794301b21587ab2b395bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc6d47f96d17471d94367bc8f8a3e3f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:55:12.852198 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-aa9aaf10-114b-4406-8e13-2cb7af398a99 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] 10.222.0.20 "GET /compute/v2.1/servers/82ec9293-050f-48f2-b0fd-e563145c6cb3" status: 200 len: 1321 microversion: 2.1 time: 0.349186 Jul 05 20:55:12.862932 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 67/122] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:55:12 2022] GET /compute/v2.1/servers/82ec9293-050f-48f2-b0fd-e563145c6cb3 => generated 1321 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 20:55:13.348256 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-4a6c3496-7e26-434d-9194-9c5717c88a53 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:55:13.349192 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-4a6c3496-7e26-434d-9194-9c5717c88a53 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] [instance: f236112c-4649-478b-a626-b84f8ff1bfe9] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:55:13.351753 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG dbcounter [-] [117627] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=117627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:55:13.358272 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-4a6c3496-7e26-434d-9194-9c5717c88a53 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:55:13.359044 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-4a6c3496-7e26-434d-9194-9c5717c88a53 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:55:13.359811 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-4a6c3496-7e26-434d-9194-9c5717c88a53 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:55:13.360245 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-4a6c3496-7e26-434d-9194-9c5717c88a53 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:55:13.558919 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-4a6c3496-7e26-434d-9194-9c5717c88a53 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eac41ce3f04450b840cff305ec1a5ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47e1ad014d542f98f6b24c8a504d166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:55:13.567398 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-4a6c3496-7e26-434d-9194-9c5717c88a53 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] 10.222.0.20 "GET /compute/v2.1/servers/f236112c-4649-478b-a626-b84f8ff1bfe9" status: 200 len: 1363 microversion: 2.1 time: 0.224607 Jul 05 20:55:13.568324 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 56/123] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:55:13 2022] GET /compute/v2.1/servers/f236112c-4649-478b-a626-b84f8ff1bfe9 => generated 1363 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 20:55:13.774081 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-d92b3c7e-ccab-4485-a1ad-f577e06d05bd tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:55:13.774693 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-d92b3c7e-ccab-4485-a1ad-f577e06d05bd tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] [instance: 52848078-62a1-484f-813c-7b3352cb3851] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:55:13.784684 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-d92b3c7e-ccab-4485-a1ad-f577e06d05bd tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:55:13.785446 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-d92b3c7e-ccab-4485-a1ad-f577e06d05bd tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:55:13.786228 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-d92b3c7e-ccab-4485-a1ad-f577e06d05bd tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:55:13.786901 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-d92b3c7e-ccab-4485-a1ad-f577e06d05bd tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:55:13.878157 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-e3cf6f86-34ea-46d2-9a43-75517f4c1e8d tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:55:13.879163 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-e3cf6f86-34ea-46d2-9a43-75517f4c1e8d tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] [instance: 82ec9293-050f-48f2-b0fd-e563145c6cb3] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:55:13.898868 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-e3cf6f86-34ea-46d2-9a43-75517f4c1e8d tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:55:13.902761 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-e3cf6f86-34ea-46d2-9a43-75517f4c1e8d tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:55:13.904007 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-e3cf6f86-34ea-46d2-9a43-75517f4c1e8d tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:55:13.920077 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-e3cf6f86-34ea-46d2-9a43-75517f4c1e8d tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:55:13.963568 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-d92b3c7e-ccab-4485-a1ad-f577e06d05bd tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:55:13.973011 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-d92b3c7e-ccab-4485-a1ad-f577e06d05bd tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:55:13.974514 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-d92b3c7e-ccab-4485-a1ad-f577e06d05bd tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:55:13.978474 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-d92b3c7e-ccab-4485-a1ad-f577e06d05bd tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] 10.222.0.20 "GET /compute/v2.1/servers/52848078-62a1-484f-813c-7b3352cb3851" status: 200 len: 1402 microversion: 2.20 time: 0.210623 Jul 05 20:55:13.979343 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 68/124] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 5 20:55:13 2022] GET /compute/v2.1/servers/52848078-62a1-484f-813c-7b3352cb3851 => generated 1402 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 20:55:14.093658 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-e3cf6f86-34ea-46d2-9a43-75517f4c1e8d tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd152763a64794301b21587ab2b395bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc6d47f96d17471d94367bc8f8a3e3f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:55:14.105154 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-e3cf6f86-34ea-46d2-9a43-75517f4c1e8d tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] 10.222.0.20 "GET /compute/v2.1/servers/82ec9293-050f-48f2-b0fd-e563145c6cb3" status: 200 len: 1321 microversion: 2.1 time: 0.238751 Jul 05 20:55:14.105862 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 57/125] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:55:13 2022] GET /compute/v2.1/servers/82ec9293-050f-48f2-b0fd-e563145c6cb3 => generated 1321 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 20:55:14.584280 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-06a4b752-bce2-48a4-862b-686dcdc63161 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:55:14.584901 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-06a4b752-bce2-48a4-862b-686dcdc63161 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] [instance: f236112c-4649-478b-a626-b84f8ff1bfe9] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:55:14.604745 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-06a4b752-bce2-48a4-862b-686dcdc63161 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:55:14.606143 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-06a4b752-bce2-48a4-862b-686dcdc63161 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:55:14.606991 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-06a4b752-bce2-48a4-862b-686dcdc63161 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:55:14.606991 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-06a4b752-bce2-48a4-862b-686dcdc63161 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:55:14.800495 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-06a4b752-bce2-48a4-862b-686dcdc63161 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eac41ce3f04450b840cff305ec1a5ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47e1ad014d542f98f6b24c8a504d166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:55:14.826517 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-06a4b752-bce2-48a4-862b-686dcdc63161 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] 10.222.0.20 "GET /compute/v2.1/servers/f236112c-4649-478b-a626-b84f8ff1bfe9" status: 200 len: 1363 microversion: 2.1 time: 0.246817 Jul 05 20:55:14.826982 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 69/126] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:55:14 2022] GET /compute/v2.1/servers/f236112c-4649-478b-a626-b84f8ff1bfe9 => generated 1363 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 20:55:14.853164 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [req-03ab21f5-ca67-4319-bdaf-6f9b0f668c71 req-3146ed15-fe16-47a7-857e-d8522ad12434 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f236112c-4649-478b-a626-b84f8ff1bfe9", "name": "network-vif-plugged", "status": "completed", "tag": "63ac1cb2-ef2b-47e3-9bb9-22cffd540dec"}, {"server_uuid": "82ec9293-050f-48f2-b0fd-e563145c6cb3", "name": "network-vif-plugged", "status": "completed", "tag": "18b93783-3039-4fd9-b75c-752a99040bff"}]} {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 20:55:14.863496 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [req-03ab21f5-ca67-4319-bdaf-6f9b0f668c71 req-3146ed15-fe16-47a7-857e-d8522ad12434 service nova] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:55:14.863959 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [req-03ab21f5-ca67-4319-bdaf-6f9b0f668c71 req-3146ed15-fe16-47a7-857e-d8522ad12434 service nova] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:55:14.877137 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.compute.server_external_events [req-03ab21f5-ca67-4319-bdaf-6f9b0f668c71 req-3146ed15-fe16-47a7-857e-d8522ad12434 service nova] Creating event network-vif-plugged:63ac1cb2-ef2b-47e3-9bb9-22cffd540dec for instance f236112c-4649-478b-a626-b84f8ff1bfe9 on hv-cinder-79760 Jul 05 20:55:14.878343 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.compute.server_external_events [req-03ab21f5-ca67-4319-bdaf-6f9b0f668c71 req-3146ed15-fe16-47a7-857e-d8522ad12434 service nova] Creating event network-vif-plugged:18b93783-3039-4fd9-b75c-752a99040bff for instance 82ec9293-050f-48f2-b0fd-e563145c6cb3 on hv-cinder-79760 Jul 05 20:55:14.891324 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [req-03ab21f5-ca67-4319-bdaf-6f9b0f668c71 req-3146ed15-fe16-47a7-857e-d8522ad12434 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.043364 Jul 05 20:55:14.892157 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 58/127] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 5 20:55:14 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 20:55:14.997922 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-c50b4e5c-67ca-450b-a369-f6650909f0c3 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:55:14.999723 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-c50b4e5c-67ca-450b-a369-f6650909f0c3 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] [instance: 52848078-62a1-484f-813c-7b3352cb3851] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:55:15.006042 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-c50b4e5c-67ca-450b-a369-f6650909f0c3 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:55:15.006565 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-c50b4e5c-67ca-450b-a369-f6650909f0c3 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:55:15.007403 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-c50b4e5c-67ca-450b-a369-f6650909f0c3 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:55:15.008023 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-c50b4e5c-67ca-450b-a369-f6650909f0c3 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:55:15.030403 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG dbcounter [-] [117628] Writing DB stats nova_cell1:SELECT=100 {{(pid=117628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:55:15.123636 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-074e02f5-ff77-4fd8-a578-c5c2a5262aad tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:55:15.124424 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-074e02f5-ff77-4fd8-a578-c5c2a5262aad tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] [instance: 82ec9293-050f-48f2-b0fd-e563145c6cb3] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:55:15.131770 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-074e02f5-ff77-4fd8-a578-c5c2a5262aad tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:55:15.132700 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-074e02f5-ff77-4fd8-a578-c5c2a5262aad tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:55:15.133729 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-074e02f5-ff77-4fd8-a578-c5c2a5262aad tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:55:15.134541 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-074e02f5-ff77-4fd8-a578-c5c2a5262aad tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:55:15.171835 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-c50b4e5c-67ca-450b-a369-f6650909f0c3 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:55:15.182023 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-c50b4e5c-67ca-450b-a369-f6650909f0c3 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:55:15.183983 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-c50b4e5c-67ca-450b-a369-f6650909f0c3 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:55:15.185135 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-c50b4e5c-67ca-450b-a369-f6650909f0c3 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] 10.222.0.20 "GET /compute/v2.1/servers/52848078-62a1-484f-813c-7b3352cb3851" status: 200 len: 1402 microversion: 2.20 time: 0.191309 Jul 05 20:55:15.185705 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 70/128] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 5 20:55:14 2022] GET /compute/v2.1/servers/52848078-62a1-484f-813c-7b3352cb3851 => generated 1402 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 20:55:15.284728 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-074e02f5-ff77-4fd8-a578-c5c2a5262aad tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd152763a64794301b21587ab2b395bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc6d47f96d17471d94367bc8f8a3e3f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:55:15.292564 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-074e02f5-ff77-4fd8-a578-c5c2a5262aad tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] 10.222.0.20 "GET /compute/v2.1/servers/82ec9293-050f-48f2-b0fd-e563145c6cb3" status: 200 len: 1321 microversion: 2.1 time: 0.173297 Jul 05 20:55:15.293162 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 59/129] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:55:15 2022] GET /compute/v2.1/servers/82ec9293-050f-48f2-b0fd-e563145c6cb3 => generated 1321 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 20:55:15.842955 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-d072276e-d2f6-413c-8b89-ef97d98eec1f tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:55:15.843556 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-d072276e-d2f6-413c-8b89-ef97d98eec1f tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] [instance: f236112c-4649-478b-a626-b84f8ff1bfe9] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:55:15.850350 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-d072276e-d2f6-413c-8b89-ef97d98eec1f tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:55:15.850790 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-d072276e-d2f6-413c-8b89-ef97d98eec1f tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:55:15.851538 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-d072276e-d2f6-413c-8b89-ef97d98eec1f tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:55:15.851960 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-d072276e-d2f6-413c-8b89-ef97d98eec1f tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:55:15.977338 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-d072276e-d2f6-413c-8b89-ef97d98eec1f tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eac41ce3f04450b840cff305ec1a5ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47e1ad014d542f98f6b24c8a504d166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:55:15.984847 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-d072276e-d2f6-413c-8b89-ef97d98eec1f tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] 10.222.0.20 "GET /compute/v2.1/servers/f236112c-4649-478b-a626-b84f8ff1bfe9" status: 200 len: 1363 microversion: 2.1 time: 0.145577 Jul 05 20:55:15.985446 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 71/130] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:55:15 2022] GET /compute/v2.1/servers/f236112c-4649-478b-a626-b84f8ff1bfe9 => generated 1363 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 20:55:16.203276 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-5419bd97-fbe3-489f-9904-d3a88a6d0af7 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:55:16.203882 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-5419bd97-fbe3-489f-9904-d3a88a6d0af7 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] [instance: 52848078-62a1-484f-813c-7b3352cb3851] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:55:16.211100 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-5419bd97-fbe3-489f-9904-d3a88a6d0af7 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:55:16.211545 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-5419bd97-fbe3-489f-9904-d3a88a6d0af7 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:55:16.212304 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-5419bd97-fbe3-489f-9904-d3a88a6d0af7 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:55:16.212754 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-5419bd97-fbe3-489f-9904-d3a88a6d0af7 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:55:16.309524 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-8e72b99a-a810-40c2-838a-357fd60efd44 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:55:16.310487 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-8e72b99a-a810-40c2-838a-357fd60efd44 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] [instance: 82ec9293-050f-48f2-b0fd-e563145c6cb3] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:55:16.319150 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-8e72b99a-a810-40c2-838a-357fd60efd44 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:55:16.320008 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-8e72b99a-a810-40c2-838a-357fd60efd44 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:55:16.321481 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-8e72b99a-a810-40c2-838a-357fd60efd44 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:55:16.322328 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-8e72b99a-a810-40c2-838a-357fd60efd44 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:55:16.351088 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-5419bd97-fbe3-489f-9904-d3a88a6d0af7 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:55:16.359844 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-5419bd97-fbe3-489f-9904-d3a88a6d0af7 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:55:16.361598 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-5419bd97-fbe3-489f-9904-d3a88a6d0af7 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:55:16.362712 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-5419bd97-fbe3-489f-9904-d3a88a6d0af7 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] 10.222.0.20 "GET /compute/v2.1/servers/52848078-62a1-484f-813c-7b3352cb3851" status: 200 len: 1402 microversion: 2.20 time: 0.163299 Jul 05 20:55:16.363466 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 60/131] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 5 20:55:16 2022] GET /compute/v2.1/servers/52848078-62a1-484f-813c-7b3352cb3851 => generated 1402 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 20:55:16.458866 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-8e72b99a-a810-40c2-838a-357fd60efd44 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd152763a64794301b21587ab2b395bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc6d47f96d17471d94367bc8f8a3e3f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:55:16.466209 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-8e72b99a-a810-40c2-838a-357fd60efd44 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] 10.222.0.20 "GET /compute/v2.1/servers/82ec9293-050f-48f2-b0fd-e563145c6cb3" status: 200 len: 1321 microversion: 2.1 time: 0.160538 Jul 05 20:55:16.466767 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 72/132] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:55:16 2022] GET /compute/v2.1/servers/82ec9293-050f-48f2-b0fd-e563145c6cb3 => generated 1321 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 20:55:17.001470 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-bc31f30d-d937-4304-9930-a4f2bb5f0078 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:55:17.001593 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-bc31f30d-d937-4304-9930-a4f2bb5f0078 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] [instance: f236112c-4649-478b-a626-b84f8ff1bfe9] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:55:17.007703 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-bc31f30d-d937-4304-9930-a4f2bb5f0078 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:55:17.008152 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-bc31f30d-d937-4304-9930-a4f2bb5f0078 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:55:17.008913 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-bc31f30d-d937-4304-9930-a4f2bb5f0078 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:55:17.009424 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-bc31f30d-d937-4304-9930-a4f2bb5f0078 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:55:17.141265 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-bc31f30d-d937-4304-9930-a4f2bb5f0078 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eac41ce3f04450b840cff305ec1a5ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47e1ad014d542f98f6b24c8a504d166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:55:17.149676 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-bc31f30d-d937-4304-9930-a4f2bb5f0078 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] 10.222.0.20 "GET /compute/v2.1/servers/f236112c-4649-478b-a626-b84f8ff1bfe9" status: 200 len: 1363 microversion: 2.1 time: 0.152654 Jul 05 20:55:17.150241 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 61/133] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:55:16 2022] GET /compute/v2.1/servers/f236112c-4649-478b-a626-b84f8ff1bfe9 => generated 1363 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 20:55:17.380118 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-5d6414bf-6a16-4171-94e1-6f2a2d994ce1 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:55:17.380757 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-5d6414bf-6a16-4171-94e1-6f2a2d994ce1 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] [instance: 52848078-62a1-484f-813c-7b3352cb3851] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:55:17.387314 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-5d6414bf-6a16-4171-94e1-6f2a2d994ce1 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:55:17.387834 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-5d6414bf-6a16-4171-94e1-6f2a2d994ce1 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:55:17.388568 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-5d6414bf-6a16-4171-94e1-6f2a2d994ce1 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:55:17.389109 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-5d6414bf-6a16-4171-94e1-6f2a2d994ce1 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:55:17.483662 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-5e9743d3-34da-4ba8-a6c6-9f5bf942b90c tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:55:17.484402 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-5e9743d3-34da-4ba8-a6c6-9f5bf942b90c tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] [instance: 82ec9293-050f-48f2-b0fd-e563145c6cb3] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:55:17.491162 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-5e9743d3-34da-4ba8-a6c6-9f5bf942b90c tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:55:17.491600 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-5e9743d3-34da-4ba8-a6c6-9f5bf942b90c tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:55:17.492349 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-5e9743d3-34da-4ba8-a6c6-9f5bf942b90c tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:55:17.492771 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-5e9743d3-34da-4ba8-a6c6-9f5bf942b90c tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:55:17.527814 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-5d6414bf-6a16-4171-94e1-6f2a2d994ce1 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:55:17.540621 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-5d6414bf-6a16-4171-94e1-6f2a2d994ce1 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:55:17.542253 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-5d6414bf-6a16-4171-94e1-6f2a2d994ce1 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:55:17.543647 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-5d6414bf-6a16-4171-94e1-6f2a2d994ce1 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] 10.222.0.20 "GET /compute/v2.1/servers/52848078-62a1-484f-813c-7b3352cb3851" status: 200 len: 1402 microversion: 2.20 time: 0.167677 Jul 05 20:55:17.544298 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 73/134] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 5 20:55:17 2022] GET /compute/v2.1/servers/52848078-62a1-484f-813c-7b3352cb3851 => generated 1402 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 20:55:17.625150 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-5e9743d3-34da-4ba8-a6c6-9f5bf942b90c tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd152763a64794301b21587ab2b395bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc6d47f96d17471d94367bc8f8a3e3f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:55:17.633444 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-5e9743d3-34da-4ba8-a6c6-9f5bf942b90c tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] 10.222.0.20 "GET /compute/v2.1/servers/82ec9293-050f-48f2-b0fd-e563145c6cb3" status: 200 len: 1321 microversion: 2.1 time: 0.153564 Jul 05 20:55:17.633944 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 62/135] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:55:17 2022] GET /compute/v2.1/servers/82ec9293-050f-48f2-b0fd-e563145c6cb3 => generated 1321 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 20:55:18.166947 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-92bae6e1-047c-488c-9acc-2e4125b67c65 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:55:18.167813 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-92bae6e1-047c-488c-9acc-2e4125b67c65 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] [instance: f236112c-4649-478b-a626-b84f8ff1bfe9] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:55:18.173900 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-92bae6e1-047c-488c-9acc-2e4125b67c65 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:55:18.177880 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-92bae6e1-047c-488c-9acc-2e4125b67c65 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:55:18.178791 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-92bae6e1-047c-488c-9acc-2e4125b67c65 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:55:18.179348 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-92bae6e1-047c-488c-9acc-2e4125b67c65 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:55:18.325311 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-92bae6e1-047c-488c-9acc-2e4125b67c65 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eac41ce3f04450b840cff305ec1a5ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47e1ad014d542f98f6b24c8a504d166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:55:18.333605 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-92bae6e1-047c-488c-9acc-2e4125b67c65 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] 10.222.0.20 "GET /compute/v2.1/servers/f236112c-4649-478b-a626-b84f8ff1bfe9" status: 200 len: 1363 microversion: 2.1 time: 0.170394 Jul 05 20:55:18.334177 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 74/136] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:55:18 2022] GET /compute/v2.1/servers/f236112c-4649-478b-a626-b84f8ff1bfe9 => generated 1363 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 20:55:18.562460 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-40690000-3d22-4ff3-8979-ac702e8252c8 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:55:18.563213 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-40690000-3d22-4ff3-8979-ac702e8252c8 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] [instance: 52848078-62a1-484f-813c-7b3352cb3851] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:55:18.571596 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-40690000-3d22-4ff3-8979-ac702e8252c8 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:55:18.573200 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-40690000-3d22-4ff3-8979-ac702e8252c8 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:55:18.575471 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-40690000-3d22-4ff3-8979-ac702e8252c8 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:55:18.575917 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-40690000-3d22-4ff3-8979-ac702e8252c8 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:55:18.650601 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-1050c0ab-66c1-449d-a377-973fca7c3863 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:55:18.651155 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-1050c0ab-66c1-449d-a377-973fca7c3863 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] [instance: 82ec9293-050f-48f2-b0fd-e563145c6cb3] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:55:18.657432 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-1050c0ab-66c1-449d-a377-973fca7c3863 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:55:18.657881 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-1050c0ab-66c1-449d-a377-973fca7c3863 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:55:18.659305 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-1050c0ab-66c1-449d-a377-973fca7c3863 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:55:18.659917 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-1050c0ab-66c1-449d-a377-973fca7c3863 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:55:18.746448 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-40690000-3d22-4ff3-8979-ac702e8252c8 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:55:18.755700 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-40690000-3d22-4ff3-8979-ac702e8252c8 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:55:18.757236 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-40690000-3d22-4ff3-8979-ac702e8252c8 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:55:18.758343 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-40690000-3d22-4ff3-8979-ac702e8252c8 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] 10.222.0.20 "GET /compute/v2.1/servers/52848078-62a1-484f-813c-7b3352cb3851" status: 200 len: 1402 microversion: 2.20 time: 0.199703 Jul 05 20:55:18.758900 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 63/137] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 5 20:55:18 2022] GET /compute/v2.1/servers/52848078-62a1-484f-813c-7b3352cb3851 => generated 1402 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 20:55:18.815456 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-1050c0ab-66c1-449d-a377-973fca7c3863 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd152763a64794301b21587ab2b395bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc6d47f96d17471d94367bc8f8a3e3f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:55:18.823155 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-1050c0ab-66c1-449d-a377-973fca7c3863 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] 10.222.0.20 "GET /compute/v2.1/servers/82ec9293-050f-48f2-b0fd-e563145c6cb3" status: 200 len: 1321 microversion: 2.1 time: 0.177007 Jul 05 20:55:18.826317 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 75/138] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:55:18 2022] GET /compute/v2.1/servers/82ec9293-050f-48f2-b0fd-e563145c6cb3 => generated 1321 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 20:55:19.350592 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-745e921e-37d6-4f53-8335-38a72327977c tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:55:19.351293 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-745e921e-37d6-4f53-8335-38a72327977c tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] [instance: f236112c-4649-478b-a626-b84f8ff1bfe9] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:55:19.360389 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-745e921e-37d6-4f53-8335-38a72327977c tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:55:19.360910 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-745e921e-37d6-4f53-8335-38a72327977c tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:55:19.362489 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-745e921e-37d6-4f53-8335-38a72327977c tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:55:19.363049 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-745e921e-37d6-4f53-8335-38a72327977c tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:55:19.505051 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-745e921e-37d6-4f53-8335-38a72327977c tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eac41ce3f04450b840cff305ec1a5ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47e1ad014d542f98f6b24c8a504d166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:55:19.513000 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-745e921e-37d6-4f53-8335-38a72327977c tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] 10.222.0.20 "GET /compute/v2.1/servers/f236112c-4649-478b-a626-b84f8ff1bfe9" status: 200 len: 1363 microversion: 2.1 time: 0.166766 Jul 05 20:55:19.513578 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 64/139] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:55:19 2022] GET /compute/v2.1/servers/f236112c-4649-478b-a626-b84f8ff1bfe9 => generated 1363 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 20:55:19.779532 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-947c8c4b-a00a-487e-9f62-a32f56a2bd97 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:55:19.779532 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-947c8c4b-a00a-487e-9f62-a32f56a2bd97 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] [instance: 52848078-62a1-484f-813c-7b3352cb3851] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:55:19.782995 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-947c8c4b-a00a-487e-9f62-a32f56a2bd97 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:55:19.784038 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-947c8c4b-a00a-487e-9f62-a32f56a2bd97 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:55:19.784877 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-947c8c4b-a00a-487e-9f62-a32f56a2bd97 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:55:19.785397 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-947c8c4b-a00a-487e-9f62-a32f56a2bd97 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:55:19.840587 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-fd69310d-814b-4f4a-ac17-2d08b3869679 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:55:19.841328 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-fd69310d-814b-4f4a-ac17-2d08b3869679 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] [instance: 82ec9293-050f-48f2-b0fd-e563145c6cb3] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:55:19.848383 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-fd69310d-814b-4f4a-ac17-2d08b3869679 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:55:19.849534 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-fd69310d-814b-4f4a-ac17-2d08b3869679 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:55:19.850172 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-fd69310d-814b-4f4a-ac17-2d08b3869679 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:55:19.850753 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-fd69310d-814b-4f4a-ac17-2d08b3869679 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:55:19.964477 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-947c8c4b-a00a-487e-9f62-a32f56a2bd97 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:55:19.983772 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-947c8c4b-a00a-487e-9f62-a32f56a2bd97 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:55:19.991546 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-947c8c4b-a00a-487e-9f62-a32f56a2bd97 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:55:20.010483 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-947c8c4b-a00a-487e-9f62-a32f56a2bd97 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] 10.222.0.20 "GET /compute/v2.1/servers/52848078-62a1-484f-813c-7b3352cb3851" status: 200 len: 1402 microversion: 2.20 time: 0.235766 Jul 05 20:55:20.011127 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 76/140] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 5 20:55:19 2022] GET /compute/v2.1/servers/52848078-62a1-484f-813c-7b3352cb3851 => generated 1402 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 20:55:20.014494 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-fd69310d-814b-4f4a-ac17-2d08b3869679 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd152763a64794301b21587ab2b395bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc6d47f96d17471d94367bc8f8a3e3f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:55:20.023748 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-fd69310d-814b-4f4a-ac17-2d08b3869679 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] 10.222.0.20 "GET /compute/v2.1/servers/82ec9293-050f-48f2-b0fd-e563145c6cb3" status: 200 len: 1321 microversion: 2.1 time: 0.187880 Jul 05 20:55:20.024305 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 65/141] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:55:19 2022] GET /compute/v2.1/servers/82ec9293-050f-48f2-b0fd-e563145c6cb3 => generated 1321 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 20:55:20.213668 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [req-53e2153b-c327-4302-912b-313eab9ac696 req-8e436b1b-4489-48a1-b00c-1ad5a8effcea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "52848078-62a1-484f-813c-7b3352cb3851", "name": "network-vif-plugged", "status": "completed", "tag": "1f543410-d13c-44b8-9d38-5417d712191c"}]} {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 20:55:20.223195 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [req-53e2153b-c327-4302-912b-313eab9ac696 req-8e436b1b-4489-48a1-b00c-1ad5a8effcea service nova] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:55:20.223508 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [req-53e2153b-c327-4302-912b-313eab9ac696 req-8e436b1b-4489-48a1-b00c-1ad5a8effcea service nova] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:55:20.235383 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.compute.server_external_events [req-53e2153b-c327-4302-912b-313eab9ac696 req-8e436b1b-4489-48a1-b00c-1ad5a8effcea service nova] Creating event network-vif-plugged:1f543410-d13c-44b8-9d38-5417d712191c for instance 52848078-62a1-484f-813c-7b3352cb3851 on hv-cinder-79760 Jul 05 20:55:20.240385 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [req-53e2153b-c327-4302-912b-313eab9ac696 req-8e436b1b-4489-48a1-b00c-1ad5a8effcea service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030277 Jul 05 20:55:20.241177 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 77/142] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 5 20:55:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 20:55:20.532994 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-f2341520-3dd9-4e84-b039-7a3041bbec74 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:55:20.534077 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-f2341520-3dd9-4e84-b039-7a3041bbec74 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] [instance: f236112c-4649-478b-a626-b84f8ff1bfe9] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:55:20.540638 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-f2341520-3dd9-4e84-b039-7a3041bbec74 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:55:20.541118 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-f2341520-3dd9-4e84-b039-7a3041bbec74 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:55:20.541879 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-f2341520-3dd9-4e84-b039-7a3041bbec74 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:55:20.542302 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-f2341520-3dd9-4e84-b039-7a3041bbec74 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:55:20.675509 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-f2341520-3dd9-4e84-b039-7a3041bbec74 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eac41ce3f04450b840cff305ec1a5ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47e1ad014d542f98f6b24c8a504d166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:55:20.682775 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-f2341520-3dd9-4e84-b039-7a3041bbec74 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] 10.222.0.20 "GET /compute/v2.1/servers/f236112c-4649-478b-a626-b84f8ff1bfe9" status: 200 len: 1363 microversion: 2.1 time: 0.153664 Jul 05 20:55:20.683324 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 66/143] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:55:20 2022] GET /compute/v2.1/servers/f236112c-4649-478b-a626-b84f8ff1bfe9 => generated 1363 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 20:55:21.033687 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-e9ec2a91-1a21-4401-a60c-eebe3dd5601d tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:55:21.040210 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-434727ae-27f4-4dc4-958f-00154c04a460 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:55:21.042273 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-434727ae-27f4-4dc4-958f-00154c04a460 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] [instance: 82ec9293-050f-48f2-b0fd-e563145c6cb3] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:55:21.051439 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-434727ae-27f4-4dc4-958f-00154c04a460 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:55:21.051884 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-434727ae-27f4-4dc4-958f-00154c04a460 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:55:21.052648 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-434727ae-27f4-4dc4-958f-00154c04a460 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:55:21.053122 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-434727ae-27f4-4dc4-958f-00154c04a460 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:55:21.057089 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-e9ec2a91-1a21-4401-a60c-eebe3dd5601d tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] [instance: 52848078-62a1-484f-813c-7b3352cb3851] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:55:21.063646 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-e9ec2a91-1a21-4401-a60c-eebe3dd5601d tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:55:21.064089 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-e9ec2a91-1a21-4401-a60c-eebe3dd5601d tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:55:21.065504 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-e9ec2a91-1a21-4401-a60c-eebe3dd5601d tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:55:21.065938 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-e9ec2a91-1a21-4401-a60c-eebe3dd5601d tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:55:21.287715 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-e9ec2a91-1a21-4401-a60c-eebe3dd5601d tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:55:21.292624 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-434727ae-27f4-4dc4-958f-00154c04a460 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd152763a64794301b21587ab2b395bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc6d47f96d17471d94367bc8f8a3e3f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:55:21.296114 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-e9ec2a91-1a21-4401-a60c-eebe3dd5601d tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:55:21.297838 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-e9ec2a91-1a21-4401-a60c-eebe3dd5601d tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:55:21.299596 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-e9ec2a91-1a21-4401-a60c-eebe3dd5601d tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] 10.222.0.20 "GET /compute/v2.1/servers/52848078-62a1-484f-813c-7b3352cb3851" status: 200 len: 1402 microversion: 2.20 time: 0.272176 Jul 05 20:55:21.300336 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 78/144] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 5 20:55:21 2022] GET /compute/v2.1/servers/52848078-62a1-484f-813c-7b3352cb3851 => generated 1402 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 20:55:21.301032 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-434727ae-27f4-4dc4-958f-00154c04a460 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] 10.222.0.20 "GET /compute/v2.1/servers/82ec9293-050f-48f2-b0fd-e563145c6cb3" status: 200 len: 1321 microversion: 2.1 time: 0.264675 Jul 05 20:55:21.301787 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 67/145] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:55:21 2022] GET /compute/v2.1/servers/82ec9293-050f-48f2-b0fd-e563145c6cb3 => generated 1321 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 20:55:21.702086 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-256fc151-669b-4562-a552-5ba45bcd8174 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:55:21.702618 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-256fc151-669b-4562-a552-5ba45bcd8174 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] [instance: f236112c-4649-478b-a626-b84f8ff1bfe9] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:55:21.713460 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-256fc151-669b-4562-a552-5ba45bcd8174 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:55:21.713904 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-256fc151-669b-4562-a552-5ba45bcd8174 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:55:21.714706 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-256fc151-669b-4562-a552-5ba45bcd8174 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:55:21.715137 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-256fc151-669b-4562-a552-5ba45bcd8174 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:55:21.851656 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-256fc151-669b-4562-a552-5ba45bcd8174 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eac41ce3f04450b840cff305ec1a5ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47e1ad014d542f98f6b24c8a504d166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:55:21.860320 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-256fc151-669b-4562-a552-5ba45bcd8174 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] 10.222.0.20 "GET /compute/v2.1/servers/f236112c-4649-478b-a626-b84f8ff1bfe9" status: 200 len: 1363 microversion: 2.1 time: 0.163733 Jul 05 20:55:21.860901 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 79/146] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:55:21 2022] GET /compute/v2.1/servers/f236112c-4649-478b-a626-b84f8ff1bfe9 => generated 1363 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 20:55:22.319244 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-4cb48090-4870-4d33-ab8c-8b52a00b7427 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:55:22.319904 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-4cb48090-4870-4d33-ab8c-8b52a00b7427 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] [instance: 82ec9293-050f-48f2-b0fd-e563145c6cb3] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:55:22.326495 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-e522e1f1-fa38-4b47-95a1-0dc4088bb5dd tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:55:22.327107 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-e522e1f1-fa38-4b47-95a1-0dc4088bb5dd tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] [instance: 52848078-62a1-484f-813c-7b3352cb3851] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:55:22.331268 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-4cb48090-4870-4d33-ab8c-8b52a00b7427 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:55:22.331722 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-4cb48090-4870-4d33-ab8c-8b52a00b7427 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:55:22.332492 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-4cb48090-4870-4d33-ab8c-8b52a00b7427 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:55:22.332917 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-4cb48090-4870-4d33-ab8c-8b52a00b7427 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:55:22.339826 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-e522e1f1-fa38-4b47-95a1-0dc4088bb5dd tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:55:22.340258 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-e522e1f1-fa38-4b47-95a1-0dc4088bb5dd tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:55:22.341594 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-e522e1f1-fa38-4b47-95a1-0dc4088bb5dd tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:55:22.342377 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-e522e1f1-fa38-4b47-95a1-0dc4088bb5dd tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:55:22.653655 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-4cb48090-4870-4d33-ab8c-8b52a00b7427 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd152763a64794301b21587ab2b395bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc6d47f96d17471d94367bc8f8a3e3f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:55:22.666206 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-4cb48090-4870-4d33-ab8c-8b52a00b7427 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] 10.222.0.20 "GET /compute/v2.1/servers/82ec9293-050f-48f2-b0fd-e563145c6cb3" status: 200 len: 1321 microversion: 2.1 time: 0.352190 Jul 05 20:55:22.676640 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 68/147] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:55:22 2022] GET /compute/v2.1/servers/82ec9293-050f-48f2-b0fd-e563145c6cb3 => generated 1321 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 20:55:22.677087 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-e522e1f1-fa38-4b47-95a1-0dc4088bb5dd tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:55:22.686256 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-e522e1f1-fa38-4b47-95a1-0dc4088bb5dd tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:55:22.687878 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-e522e1f1-fa38-4b47-95a1-0dc4088bb5dd tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:55:22.689224 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-e522e1f1-fa38-4b47-95a1-0dc4088bb5dd tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] 10.222.0.20 "GET /compute/v2.1/servers/52848078-62a1-484f-813c-7b3352cb3851" status: 200 len: 1402 microversion: 2.20 time: 0.374977 Jul 05 20:55:22.690190 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 80/148] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 5 20:55:22 2022] GET /compute/v2.1/servers/52848078-62a1-484f-813c-7b3352cb3851 => generated 1402 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 05 20:55:22.880719 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-f607be60-2dc0-42d3-bdc9-4562d85ad12d tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:55:22.881909 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-f607be60-2dc0-42d3-bdc9-4562d85ad12d tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] [instance: f236112c-4649-478b-a626-b84f8ff1bfe9] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:55:22.895757 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-f607be60-2dc0-42d3-bdc9-4562d85ad12d tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:55:22.899279 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-f607be60-2dc0-42d3-bdc9-4562d85ad12d tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:55:22.901122 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-f607be60-2dc0-42d3-bdc9-4562d85ad12d tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:55:22.912096 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-f607be60-2dc0-42d3-bdc9-4562d85ad12d tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:55:22.925598 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG dbcounter [-] [117627] Writing DB stats nova_cell1:SELECT=100 {{(pid=117627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:55:23.088869 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-f607be60-2dc0-42d3-bdc9-4562d85ad12d tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eac41ce3f04450b840cff305ec1a5ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47e1ad014d542f98f6b24c8a504d166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:55:23.096967 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-f607be60-2dc0-42d3-bdc9-4562d85ad12d tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] 10.222.0.20 "GET /compute/v2.1/servers/f236112c-4649-478b-a626-b84f8ff1bfe9" status: 200 len: 1363 microversion: 2.1 time: 0.221868 Jul 05 20:55:23.097847 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 69/149] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:55:22 2022] GET /compute/v2.1/servers/f236112c-4649-478b-a626-b84f8ff1bfe9 => generated 1363 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 20:55:23.337393 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-923f006b-a6e1-41bd-ba8f-d302fc69db23 tempest-DeleteServersTestJSON-389510094 tempest-DeleteServersTestJSON-389510094-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:55:23.337924 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-923f006b-a6e1-41bd-ba8f-d302fc69db23 tempest-DeleteServersTestJSON-389510094 tempest-DeleteServersTestJSON-389510094-project] [instance: 1159954e-7c69-48d8-b051-5a7b1108da69] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:55:23.345128 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-923f006b-a6e1-41bd-ba8f-d302fc69db23 tempest-DeleteServersTestJSON-389510094 tempest-DeleteServersTestJSON-389510094-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:55:23.345563 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-923f006b-a6e1-41bd-ba8f-d302fc69db23 tempest-DeleteServersTestJSON-389510094 tempest-DeleteServersTestJSON-389510094-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:55:23.346358 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-923f006b-a6e1-41bd-ba8f-d302fc69db23 tempest-DeleteServersTestJSON-389510094 tempest-DeleteServersTestJSON-389510094-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:55:23.346778 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-923f006b-a6e1-41bd-ba8f-d302fc69db23 tempest-DeleteServersTestJSON-389510094 tempest-DeleteServersTestJSON-389510094-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:55:23.372691 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-923f006b-a6e1-41bd-ba8f-d302fc69db23 tempest-DeleteServersTestJSON-389510094 tempest-DeleteServersTestJSON-389510094-project] [instance: 1159954e-7c69-48d8-b051-5a7b1108da69] Going to try to terminate instance {{(pid=117628) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 05 20:55:23.504292 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-923f006b-a6e1-41bd-ba8f-d302fc69db23 tempest-DeleteServersTestJSON-389510094 tempest-DeleteServersTestJSON-389510094-project] 10.222.0.20 "DELETE /compute/v2.1/servers/1159954e-7c69-48d8-b051-5a7b1108da69" status: 204 len: 0 microversion: 2.1 time: 0.171337 Jul 05 20:55:23.504882 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 81/150] 10.222.0.20 () {58 vars in 1238 bytes} [Tue Jul 5 20:55:23 2022] DELETE /compute/v2.1/servers/1159954e-7c69-48d8-b051-5a7b1108da69 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 05 20:55:23.513059 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-a03b0ef3-35fe-474c-897f-d4a7eee43113 tempest-DeleteServersTestJSON-389510094 tempest-DeleteServersTestJSON-389510094-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:55:23.514362 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-a03b0ef3-35fe-474c-897f-d4a7eee43113 tempest-DeleteServersTestJSON-389510094 tempest-DeleteServersTestJSON-389510094-project] [instance: 1159954e-7c69-48d8-b051-5a7b1108da69] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:55:23.524790 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-a03b0ef3-35fe-474c-897f-d4a7eee43113 tempest-DeleteServersTestJSON-389510094 tempest-DeleteServersTestJSON-389510094-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:55:23.525273 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-a03b0ef3-35fe-474c-897f-d4a7eee43113 tempest-DeleteServersTestJSON-389510094 tempest-DeleteServersTestJSON-389510094-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:55:23.526034 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-a03b0ef3-35fe-474c-897f-d4a7eee43113 tempest-DeleteServersTestJSON-389510094 tempest-DeleteServersTestJSON-389510094-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:55:23.526461 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-a03b0ef3-35fe-474c-897f-d4a7eee43113 tempest-DeleteServersTestJSON-389510094 tempest-DeleteServersTestJSON-389510094-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:55:23.669439 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-a03b0ef3-35fe-474c-897f-d4a7eee43113 tempest-DeleteServersTestJSON-389510094 tempest-DeleteServersTestJSON-389510094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5063db22225a4d0b97ec5dcac8770045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '873a5ea6741e4762857e2bae05f5e06d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:55:23.677923 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-a03b0ef3-35fe-474c-897f-d4a7eee43113 tempest-DeleteServersTestJSON-389510094 tempest-DeleteServersTestJSON-389510094-project] 10.222.0.20 "GET /compute/v2.1/servers/1159954e-7c69-48d8-b051-5a7b1108da69" status: 200 len: 1554 microversion: 2.1 time: 0.168785 Jul 05 20:55:23.678672 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 70/151] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:55:23 2022] GET /compute/v2.1/servers/1159954e-7c69-48d8-b051-5a7b1108da69 => generated 1554 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 20:55:23.684265 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-fbde38ad-62ee-4d66-9cc6-07c975f25264 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:55:23.684997 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-fbde38ad-62ee-4d66-9cc6-07c975f25264 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] [instance: 82ec9293-050f-48f2-b0fd-e563145c6cb3] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:55:23.692338 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-fbde38ad-62ee-4d66-9cc6-07c975f25264 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:55:23.692782 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-fbde38ad-62ee-4d66-9cc6-07c975f25264 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:55:23.693576 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-fbde38ad-62ee-4d66-9cc6-07c975f25264 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:55:23.694004 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-fbde38ad-62ee-4d66-9cc6-07c975f25264 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:55:23.708456 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-922d92bf-0f1e-4529-80e1-2cf621037f63 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:55:23.709414 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-922d92bf-0f1e-4529-80e1-2cf621037f63 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] [instance: 52848078-62a1-484f-813c-7b3352cb3851] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:55:23.715328 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-922d92bf-0f1e-4529-80e1-2cf621037f63 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:55:23.715776 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-922d92bf-0f1e-4529-80e1-2cf621037f63 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:55:23.716528 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-922d92bf-0f1e-4529-80e1-2cf621037f63 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:55:23.716979 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-922d92bf-0f1e-4529-80e1-2cf621037f63 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:55:23.892010 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-fbde38ad-62ee-4d66-9cc6-07c975f25264 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd152763a64794301b21587ab2b395bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc6d47f96d17471d94367bc8f8a3e3f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:55:23.899760 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-fbde38ad-62ee-4d66-9cc6-07c975f25264 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] 10.222.0.20 "GET /compute/v2.1/servers/82ec9293-050f-48f2-b0fd-e563145c6cb3" status: 200 len: 1321 microversion: 2.1 time: 0.219582 Jul 05 20:55:23.900337 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 82/152] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:55:23 2022] GET /compute/v2.1/servers/82ec9293-050f-48f2-b0fd-e563145c6cb3 => generated 1321 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 20:55:23.904415 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-922d92bf-0f1e-4529-80e1-2cf621037f63 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:55:23.913219 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-922d92bf-0f1e-4529-80e1-2cf621037f63 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:55:23.914703 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-922d92bf-0f1e-4529-80e1-2cf621037f63 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:55:23.915787 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-922d92bf-0f1e-4529-80e1-2cf621037f63 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] 10.222.0.20 "GET /compute/v2.1/servers/52848078-62a1-484f-813c-7b3352cb3851" status: 200 len: 1402 microversion: 2.20 time: 0.211184 Jul 05 20:55:23.916319 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 71/153] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 5 20:55:23 2022] GET /compute/v2.1/servers/52848078-62a1-484f-813c-7b3352cb3851 => generated 1402 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 20:55:24.115280 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-39962f7d-f1fc-44a7-bb98-4a0991f6c7c1 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:55:24.116076 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-39962f7d-f1fc-44a7-bb98-4a0991f6c7c1 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] [instance: f236112c-4649-478b-a626-b84f8ff1bfe9] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:55:24.122118 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-39962f7d-f1fc-44a7-bb98-4a0991f6c7c1 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:55:24.122908 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-39962f7d-f1fc-44a7-bb98-4a0991f6c7c1 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:55:24.131832 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-39962f7d-f1fc-44a7-bb98-4a0991f6c7c1 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:55:24.132353 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-39962f7d-f1fc-44a7-bb98-4a0991f6c7c1 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:55:24.269484 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-39962f7d-f1fc-44a7-bb98-4a0991f6c7c1 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eac41ce3f04450b840cff305ec1a5ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47e1ad014d542f98f6b24c8a504d166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:55:24.277605 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-39962f7d-f1fc-44a7-bb98-4a0991f6c7c1 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] 10.222.0.20 "GET /compute/v2.1/servers/f236112c-4649-478b-a626-b84f8ff1bfe9" status: 200 len: 1363 microversion: 2.1 time: 0.167326 Jul 05 20:55:24.278164 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 83/154] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:55:24 2022] GET /compute/v2.1/servers/f236112c-4649-478b-a626-b84f8ff1bfe9 => generated 1363 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 20:55:24.695630 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-10796583-6485-423e-b82d-66a0791c00c0 tempest-DeleteServersTestJSON-389510094 tempest-DeleteServersTestJSON-389510094-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:55:24.696233 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-10796583-6485-423e-b82d-66a0791c00c0 tempest-DeleteServersTestJSON-389510094 tempest-DeleteServersTestJSON-389510094-project] [instance: 1159954e-7c69-48d8-b051-5a7b1108da69] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:55:24.703176 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-10796583-6485-423e-b82d-66a0791c00c0 tempest-DeleteServersTestJSON-389510094 tempest-DeleteServersTestJSON-389510094-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:55:24.703624 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-10796583-6485-423e-b82d-66a0791c00c0 tempest-DeleteServersTestJSON-389510094 tempest-DeleteServersTestJSON-389510094-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:55:24.704381 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-10796583-6485-423e-b82d-66a0791c00c0 tempest-DeleteServersTestJSON-389510094 tempest-DeleteServersTestJSON-389510094-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:55:24.704808 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-10796583-6485-423e-b82d-66a0791c00c0 tempest-DeleteServersTestJSON-389510094 tempest-DeleteServersTestJSON-389510094-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:55:24.898991 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-10796583-6485-423e-b82d-66a0791c00c0 tempest-DeleteServersTestJSON-389510094 tempest-DeleteServersTestJSON-389510094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5063db22225a4d0b97ec5dcac8770045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '873a5ea6741e4762857e2bae05f5e06d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:55:24.907519 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-10796583-6485-423e-b82d-66a0791c00c0 tempest-DeleteServersTestJSON-389510094 tempest-DeleteServersTestJSON-389510094-project] 10.222.0.20 "GET /compute/v2.1/servers/1159954e-7c69-48d8-b051-5a7b1108da69" status: 200 len: 1554 microversion: 2.1 time: 0.215697 Jul 05 20:55:24.908104 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 72/155] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:55:24 2022] GET /compute/v2.1/servers/1159954e-7c69-48d8-b051-5a7b1108da69 => generated 1554 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 20:55:24.917178 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-9d3f081b-d271-4d32-a392-d90fee7ea1f1 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:55:24.917883 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-9d3f081b-d271-4d32-a392-d90fee7ea1f1 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] [instance: 82ec9293-050f-48f2-b0fd-e563145c6cb3] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:55:24.924537 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-9d3f081b-d271-4d32-a392-d90fee7ea1f1 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:55:24.925181 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-9d3f081b-d271-4d32-a392-d90fee7ea1f1 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:55:24.925938 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-9d3f081b-d271-4d32-a392-d90fee7ea1f1 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:55:24.926378 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-9d3f081b-d271-4d32-a392-d90fee7ea1f1 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:55:24.933688 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-8eb29fdf-13c8-479e-a08e-0ccce22e50ec tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:55:24.934652 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-8eb29fdf-13c8-479e-a08e-0ccce22e50ec tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] [instance: 52848078-62a1-484f-813c-7b3352cb3851] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:55:24.945226 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-8eb29fdf-13c8-479e-a08e-0ccce22e50ec tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:55:24.945673 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-8eb29fdf-13c8-479e-a08e-0ccce22e50ec tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:55:24.946451 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-8eb29fdf-13c8-479e-a08e-0ccce22e50ec tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:55:24.947134 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-8eb29fdf-13c8-479e-a08e-0ccce22e50ec tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:55:25.153584 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-9d3f081b-d271-4d32-a392-d90fee7ea1f1 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd152763a64794301b21587ab2b395bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc6d47f96d17471d94367bc8f8a3e3f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:55:25.159096 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-8eb29fdf-13c8-479e-a08e-0ccce22e50ec tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:55:25.168498 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-8eb29fdf-13c8-479e-a08e-0ccce22e50ec tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:55:25.170088 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-8eb29fdf-13c8-479e-a08e-0ccce22e50ec tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:55:25.170620 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-9d3f081b-d271-4d32-a392-d90fee7ea1f1 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] 10.222.0.20 "GET /compute/v2.1/servers/82ec9293-050f-48f2-b0fd-e563145c6cb3" status: 200 len: 1515 microversion: 2.1 time: 0.256643 Jul 05 20:55:25.171132 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-8eb29fdf-13c8-479e-a08e-0ccce22e50ec tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] 10.222.0.20 "GET /compute/v2.1/servers/52848078-62a1-484f-813c-7b3352cb3851" status: 200 len: 1402 microversion: 2.20 time: 0.241648 Jul 05 20:55:25.171492 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 84/156] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:55:24 2022] GET /compute/v2.1/servers/82ec9293-050f-48f2-b0fd-e563145c6cb3 => generated 1515 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 20:55:25.173498 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 73/157] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 5 20:55:24 2022] GET /compute/v2.1/servers/52848078-62a1-484f-813c-7b3352cb3851 => generated 1402 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 20:55:25.189145 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-56113ac4-6827-4988-af35-e427e665a90f tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 20:55:25.190782 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-56113ac4-6827-4988-af35-e427e665a90f tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] [instance: 82ec9293-050f-48f2-b0fd-e563145c6cb3] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:55:25.197026 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-56113ac4-6827-4988-af35-e427e665a90f tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:55:25.197475 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-56113ac4-6827-4988-af35-e427e665a90f tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:55:25.198442 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-56113ac4-6827-4988-af35-e427e665a90f tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:55:25.199037 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-56113ac4-6827-4988-af35-e427e665a90f tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:55:25.223867 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.objects.instance [None req-56113ac4-6827-4988-af35-e427e665a90f tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lazy-loading 'flavor' on Instance uuid 82ec9293-050f-48f2-b0fd-e563145c6cb3 {{(pid=117628) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 05 20:55:25.273844 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG dbcounter [-] [117628] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:55:25.301200 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-df7ab835-40c3-47a3-a99b-da1703ea8008 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:55:25.302282 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-df7ab835-40c3-47a3-a99b-da1703ea8008 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] [instance: f236112c-4649-478b-a626-b84f8ff1bfe9] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:55:25.310883 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-df7ab835-40c3-47a3-a99b-da1703ea8008 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:55:25.311767 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-df7ab835-40c3-47a3-a99b-da1703ea8008 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:55:25.314004 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-df7ab835-40c3-47a3-a99b-da1703ea8008 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:55:25.314618 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-df7ab835-40c3-47a3-a99b-da1703ea8008 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:55:25.349119 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-56113ac4-6827-4988-af35-e427e665a90f tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] 10.222.0.20 "POST /compute/v2.1/servers/82ec9293-050f-48f2-b0fd-e563145c6cb3/action" status: 200 len: 32 microversion: 2.1 time: 0.163830 Jul 05 20:55:25.350589 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 85/158] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Jul 5 20:55:25 2022] POST /compute/v2.1/servers/82ec9293-050f-48f2-b0fd-e563145c6cb3/action => generated 32 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 05 20:55:25.365949 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-8dec4368-7657-45f9-8d1a-7097b3ffdc87 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:55:25.366808 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-8dec4368-7657-45f9-8d1a-7097b3ffdc87 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] [instance: 82ec9293-050f-48f2-b0fd-e563145c6cb3] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:55:25.377153 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-8dec4368-7657-45f9-8d1a-7097b3ffdc87 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:55:25.377918 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-8dec4368-7657-45f9-8d1a-7097b3ffdc87 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:55:25.378883 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-8dec4368-7657-45f9-8d1a-7097b3ffdc87 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:55:25.379560 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-8dec4368-7657-45f9-8d1a-7097b3ffdc87 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:55:25.788115 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-df7ab835-40c3-47a3-a99b-da1703ea8008 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eac41ce3f04450b840cff305ec1a5ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47e1ad014d542f98f6b24c8a504d166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:55:25.800305 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-df7ab835-40c3-47a3-a99b-da1703ea8008 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] 10.222.0.20 "GET /compute/v2.1/servers/f236112c-4649-478b-a626-b84f8ff1bfe9" status: 200 len: 1363 microversion: 2.1 time: 0.506658 Jul 05 20:55:25.801604 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 74/159] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:55:25 2022] GET /compute/v2.1/servers/f236112c-4649-478b-a626-b84f8ff1bfe9 => generated 1363 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 20:55:25.822429 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-8dec4368-7657-45f9-8d1a-7097b3ffdc87 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd152763a64794301b21587ab2b395bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc6d47f96d17471d94367bc8f8a3e3f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:55:25.831416 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-8dec4368-7657-45f9-8d1a-7097b3ffdc87 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] 10.222.0.20 "GET /compute/v2.1/servers/82ec9293-050f-48f2-b0fd-e563145c6cb3" status: 200 len: 1521 microversion: 2.1 time: 0.475137 Jul 05 20:55:25.832151 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 86/160] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:55:25 2022] GET /compute/v2.1/servers/82ec9293-050f-48f2-b0fd-e563145c6cb3 => generated 1521 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 20:55:25.924668 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-4eb54d77-4061-466d-af81-8fc16395a375 tempest-DeleteServersTestJSON-389510094 tempest-DeleteServersTestJSON-389510094-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:55:25.925381 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-4eb54d77-4061-466d-af81-8fc16395a375 tempest-DeleteServersTestJSON-389510094 tempest-DeleteServersTestJSON-389510094-project] [instance: 1159954e-7c69-48d8-b051-5a7b1108da69] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:55:25.931620 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-4eb54d77-4061-466d-af81-8fc16395a375 tempest-DeleteServersTestJSON-389510094 tempest-DeleteServersTestJSON-389510094-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:55:25.932070 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-4eb54d77-4061-466d-af81-8fc16395a375 tempest-DeleteServersTestJSON-389510094 tempest-DeleteServersTestJSON-389510094-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:55:25.933033 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-4eb54d77-4061-466d-af81-8fc16395a375 tempest-DeleteServersTestJSON-389510094 tempest-DeleteServersTestJSON-389510094-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:55:25.933689 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-4eb54d77-4061-466d-af81-8fc16395a375 tempest-DeleteServersTestJSON-389510094 tempest-DeleteServersTestJSON-389510094-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:55:26.159246 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-4eb54d77-4061-466d-af81-8fc16395a375 tempest-DeleteServersTestJSON-389510094 tempest-DeleteServersTestJSON-389510094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5063db22225a4d0b97ec5dcac8770045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '873a5ea6741e4762857e2bae05f5e06d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:55:26.169666 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-4eb54d77-4061-466d-af81-8fc16395a375 tempest-DeleteServersTestJSON-389510094 tempest-DeleteServersTestJSON-389510094-project] 10.222.0.20 "GET /compute/v2.1/servers/1159954e-7c69-48d8-b051-5a7b1108da69" status: 200 len: 1554 microversion: 2.1 time: 0.248910 Jul 05 20:55:26.170541 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 75/161] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:55:25 2022] GET /compute/v2.1/servers/1159954e-7c69-48d8-b051-5a7b1108da69 => generated 1554 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 20:55:26.211259 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-398e5d57-b8f8-495c-ba99-6fe246a4f620 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:55:26.213885 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-398e5d57-b8f8-495c-ba99-6fe246a4f620 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] [instance: 52848078-62a1-484f-813c-7b3352cb3851] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:55:26.221384 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG dbcounter [-] [117628] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1 {{(pid=117628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:55:26.223313 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-398e5d57-b8f8-495c-ba99-6fe246a4f620 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:55:26.223881 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-398e5d57-b8f8-495c-ba99-6fe246a4f620 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:55:26.224863 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-398e5d57-b8f8-495c-ba99-6fe246a4f620 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:55:26.225462 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-398e5d57-b8f8-495c-ba99-6fe246a4f620 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:55:26.395021 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-398e5d57-b8f8-495c-ba99-6fe246a4f620 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:55:26.411332 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-398e5d57-b8f8-495c-ba99-6fe246a4f620 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:55:26.412837 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-398e5d57-b8f8-495c-ba99-6fe246a4f620 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:55:26.414240 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-398e5d57-b8f8-495c-ba99-6fe246a4f620 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] 10.222.0.20 "GET /compute/v2.1/servers/52848078-62a1-484f-813c-7b3352cb3851" status: 200 len: 1402 microversion: 2.20 time: 0.216647 Jul 05 20:55:26.425707 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 87/162] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 5 20:55:26 2022] GET /compute/v2.1/servers/52848078-62a1-484f-813c-7b3352cb3851 => generated 1402 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 05 20:55:26.818145 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-89778279-d309-40e7-b1d2-a547b78b5340 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:55:26.818755 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-89778279-d309-40e7-b1d2-a547b78b5340 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] [instance: f236112c-4649-478b-a626-b84f8ff1bfe9] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:55:26.826992 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-89778279-d309-40e7-b1d2-a547b78b5340 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:55:26.827631 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-89778279-d309-40e7-b1d2-a547b78b5340 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:55:26.828525 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-89778279-d309-40e7-b1d2-a547b78b5340 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:55:26.829269 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-89778279-d309-40e7-b1d2-a547b78b5340 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:55:26.855323 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-6664053c-49ca-4067-b28a-d22e0ed27f93 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:55:26.856303 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-6664053c-49ca-4067-b28a-d22e0ed27f93 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] [instance: 82ec9293-050f-48f2-b0fd-e563145c6cb3] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:55:26.866906 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-6664053c-49ca-4067-b28a-d22e0ed27f93 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:55:26.867948 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-6664053c-49ca-4067-b28a-d22e0ed27f93 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:55:26.868869 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-6664053c-49ca-4067-b28a-d22e0ed27f93 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:55:26.870519 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-6664053c-49ca-4067-b28a-d22e0ed27f93 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:55:27.056658 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-89778279-d309-40e7-b1d2-a547b78b5340 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eac41ce3f04450b840cff305ec1a5ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47e1ad014d542f98f6b24c8a504d166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:55:27.068055 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-89778279-d309-40e7-b1d2-a547b78b5340 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] 10.222.0.20 "GET /compute/v2.1/servers/f236112c-4649-478b-a626-b84f8ff1bfe9" status: 200 len: 1363 microversion: 2.1 time: 0.253702 Jul 05 20:55:27.072511 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-6664053c-49ca-4067-b28a-d22e0ed27f93 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd152763a64794301b21587ab2b395bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc6d47f96d17471d94367bc8f8a3e3f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:55:27.079434 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 76/163] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:55:26 2022] GET /compute/v2.1/servers/f236112c-4649-478b-a626-b84f8ff1bfe9 => generated 1363 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 20:55:27.090139 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-6664053c-49ca-4067-b28a-d22e0ed27f93 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] 10.222.0.20 "GET /compute/v2.1/servers/82ec9293-050f-48f2-b0fd-e563145c6cb3" status: 200 len: 1521 microversion: 2.1 time: 0.242793 Jul 05 20:55:27.090726 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 88/164] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:55:26 2022] GET /compute/v2.1/servers/82ec9293-050f-48f2-b0fd-e563145c6cb3 => generated 1521 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 20:55:27.188507 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-bc7df722-098f-4ce7-93ce-2908605a43ae tempest-DeleteServersTestJSON-389510094 tempest-DeleteServersTestJSON-389510094-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:55:27.189468 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-bc7df722-098f-4ce7-93ce-2908605a43ae tempest-DeleteServersTestJSON-389510094 tempest-DeleteServersTestJSON-389510094-project] [instance: 1159954e-7c69-48d8-b051-5a7b1108da69] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:55:27.198663 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-bc7df722-098f-4ce7-93ce-2908605a43ae tempest-DeleteServersTestJSON-389510094 tempest-DeleteServersTestJSON-389510094-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:55:27.199781 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-bc7df722-098f-4ce7-93ce-2908605a43ae tempest-DeleteServersTestJSON-389510094 tempest-DeleteServersTestJSON-389510094-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:55:27.200948 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-bc7df722-098f-4ce7-93ce-2908605a43ae tempest-DeleteServersTestJSON-389510094 tempest-DeleteServersTestJSON-389510094-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:55:27.201423 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-bc7df722-098f-4ce7-93ce-2908605a43ae tempest-DeleteServersTestJSON-389510094 tempest-DeleteServersTestJSON-389510094-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:55:27.360577 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-bc7df722-098f-4ce7-93ce-2908605a43ae tempest-DeleteServersTestJSON-389510094 tempest-DeleteServersTestJSON-389510094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5063db22225a4d0b97ec5dcac8770045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '873a5ea6741e4762857e2bae05f5e06d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:55:27.369904 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-bc7df722-098f-4ce7-93ce-2908605a43ae tempest-DeleteServersTestJSON-389510094 tempest-DeleteServersTestJSON-389510094-project] 10.222.0.20 "GET /compute/v2.1/servers/1159954e-7c69-48d8-b051-5a7b1108da69" status: 200 len: 1554 microversion: 2.1 time: 0.186013 Jul 05 20:55:27.371326 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 77/165] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:55:27 2022] GET /compute/v2.1/servers/1159954e-7c69-48d8-b051-5a7b1108da69 => generated 1554 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 20:55:27.432858 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-2464f89c-2bd1-412f-a0ea-6de9e2239585 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:55:27.433671 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-2464f89c-2bd1-412f-a0ea-6de9e2239585 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] [instance: 52848078-62a1-484f-813c-7b3352cb3851] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:55:27.444537 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-2464f89c-2bd1-412f-a0ea-6de9e2239585 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:55:27.445010 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-2464f89c-2bd1-412f-a0ea-6de9e2239585 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:55:27.445841 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-2464f89c-2bd1-412f-a0ea-6de9e2239585 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:55:27.446451 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-2464f89c-2bd1-412f-a0ea-6de9e2239585 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:55:27.607493 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-2464f89c-2bd1-412f-a0ea-6de9e2239585 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:55:27.624974 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-2464f89c-2bd1-412f-a0ea-6de9e2239585 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:55:27.624974 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-2464f89c-2bd1-412f-a0ea-6de9e2239585 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:55:27.624974 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-2464f89c-2bd1-412f-a0ea-6de9e2239585 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] 10.222.0.20 "GET /compute/v2.1/servers/52848078-62a1-484f-813c-7b3352cb3851" status: 200 len: 1402 microversion: 2.20 time: 0.195475 Jul 05 20:55:27.625322 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 89/166] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 5 20:55:27 2022] GET /compute/v2.1/servers/52848078-62a1-484f-813c-7b3352cb3851 => generated 1402 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 20:55:28.096550 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-b0b952ae-3eae-46ef-812c-0ed01a85058f tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:55:28.097360 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-b0b952ae-3eae-46ef-812c-0ed01a85058f tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] [instance: f236112c-4649-478b-a626-b84f8ff1bfe9] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:55:28.104724 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-b0b952ae-3eae-46ef-812c-0ed01a85058f tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:55:28.105241 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-b0b952ae-3eae-46ef-812c-0ed01a85058f tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:55:28.106027 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-b0b952ae-3eae-46ef-812c-0ed01a85058f tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:55:28.106455 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-b0b952ae-3eae-46ef-812c-0ed01a85058f tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:55:28.107557 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-dd5b4fbc-b507-4915-a812-4ef5704db8e9 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:55:28.108161 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-dd5b4fbc-b507-4915-a812-4ef5704db8e9 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] [instance: 82ec9293-050f-48f2-b0fd-e563145c6cb3] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:55:28.116341 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-dd5b4fbc-b507-4915-a812-4ef5704db8e9 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:55:28.117114 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-dd5b4fbc-b507-4915-a812-4ef5704db8e9 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:55:28.117887 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-dd5b4fbc-b507-4915-a812-4ef5704db8e9 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:55:28.118371 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-dd5b4fbc-b507-4915-a812-4ef5704db8e9 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:55:28.357666 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-b0b952ae-3eae-46ef-812c-0ed01a85058f tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eac41ce3f04450b840cff305ec1a5ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47e1ad014d542f98f6b24c8a504d166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:55:28.368436 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-b0b952ae-3eae-46ef-812c-0ed01a85058f tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] 10.222.0.20 "GET /compute/v2.1/servers/f236112c-4649-478b-a626-b84f8ff1bfe9" status: 200 len: 1548 microversion: 2.1 time: 0.276776 Jul 05 20:55:28.375602 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-dd5b4fbc-b507-4915-a812-4ef5704db8e9 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd152763a64794301b21587ab2b395bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc6d47f96d17471d94367bc8f8a3e3f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:55:28.379048 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 78/167] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:55:28 2022] GET /compute/v2.1/servers/f236112c-4649-478b-a626-b84f8ff1bfe9 => generated 1548 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 20:55:28.394140 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-dd5b4fbc-b507-4915-a812-4ef5704db8e9 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] 10.222.0.20 "GET /compute/v2.1/servers/82ec9293-050f-48f2-b0fd-e563145c6cb3" status: 200 len: 1521 microversion: 2.1 time: 0.290388 Jul 05 20:55:28.403478 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 90/168] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:55:28 2022] GET /compute/v2.1/servers/82ec9293-050f-48f2-b0fd-e563145c6cb3 => generated 1521 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 20:55:28.404180 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-ac303bce-f99c-41d1-a8dc-ced43928536d tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:55:28.404180 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-ac303bce-f99c-41d1-a8dc-ced43928536d tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] [instance: f236112c-4649-478b-a626-b84f8ff1bfe9] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:55:28.405685 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-1ed53d11-195d-4d6e-ac01-4e699827585e tempest-DeleteServersTestJSON-389510094 tempest-DeleteServersTestJSON-389510094-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:55:28.406526 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-1ed53d11-195d-4d6e-ac01-4e699827585e tempest-DeleteServersTestJSON-389510094 tempest-DeleteServersTestJSON-389510094-project] [instance: 1159954e-7c69-48d8-b051-5a7b1108da69] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:55:28.412638 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-ac303bce-f99c-41d1-a8dc-ced43928536d tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:55:28.413152 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-ac303bce-f99c-41d1-a8dc-ced43928536d tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:55:28.413921 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-ac303bce-f99c-41d1-a8dc-ced43928536d tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:55:28.414352 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-ac303bce-f99c-41d1-a8dc-ced43928536d tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:55:28.417369 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-1ed53d11-195d-4d6e-ac01-4e699827585e tempest-DeleteServersTestJSON-389510094 tempest-DeleteServersTestJSON-389510094-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:55:28.418075 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-1ed53d11-195d-4d6e-ac01-4e699827585e tempest-DeleteServersTestJSON-389510094 tempest-DeleteServersTestJSON-389510094-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:55:28.419205 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-1ed53d11-195d-4d6e-ac01-4e699827585e tempest-DeleteServersTestJSON-389510094 tempest-DeleteServersTestJSON-389510094-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:55:28.420025 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-1ed53d11-195d-4d6e-ac01-4e699827585e tempest-DeleteServersTestJSON-389510094 tempest-DeleteServersTestJSON-389510094-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:55:28.563097 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-ac303bce-f99c-41d1-a8dc-ced43928536d tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] 10.222.0.20 "GET /compute/v2.1/servers/f236112c-4649-478b-a626-b84f8ff1bfe9/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.175718 Jul 05 20:55:28.567693 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 79/169] 10.222.0.20 () {58 vars in 1274 bytes} [Tue Jul 5 20:55:28 2022] GET /compute/v2.1/servers/f236112c-4649-478b-a626-b84f8ff1bfe9/os-interface => generated 284 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 20:55:28.651155 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-744df111-6255-4fb6-a039-0309e7f12b5c tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:55:28.652481 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-744df111-6255-4fb6-a039-0309e7f12b5c tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] [instance: 52848078-62a1-484f-813c-7b3352cb3851] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:55:28.662046 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-1ed53d11-195d-4d6e-ac01-4e699827585e tempest-DeleteServersTestJSON-389510094 tempest-DeleteServersTestJSON-389510094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5063db22225a4d0b97ec5dcac8770045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '873a5ea6741e4762857e2bae05f5e06d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:55:28.670414 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-744df111-6255-4fb6-a039-0309e7f12b5c tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:55:28.671068 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-744df111-6255-4fb6-a039-0309e7f12b5c tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:55:28.672021 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-744df111-6255-4fb6-a039-0309e7f12b5c tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:55:28.672634 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-744df111-6255-4fb6-a039-0309e7f12b5c tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:55:28.672742 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-1ed53d11-195d-4d6e-ac01-4e699827585e tempest-DeleteServersTestJSON-389510094 tempest-DeleteServersTestJSON-389510094-project] 10.222.0.20 "GET /compute/v2.1/servers/1159954e-7c69-48d8-b051-5a7b1108da69" status: 200 len: 1554 microversion: 2.1 time: 0.276755 Jul 05 20:55:28.673319 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 91/170] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:55:28 2022] GET /compute/v2.1/servers/1159954e-7c69-48d8-b051-5a7b1108da69 => generated 1554 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 20:55:28.880854 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-744df111-6255-4fb6-a039-0309e7f12b5c tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:55:28.888825 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-744df111-6255-4fb6-a039-0309e7f12b5c tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:55:28.890589 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-744df111-6255-4fb6-a039-0309e7f12b5c tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:55:28.891812 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-744df111-6255-4fb6-a039-0309e7f12b5c tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] 10.222.0.20 "GET /compute/v2.1/servers/52848078-62a1-484f-813c-7b3352cb3851" status: 200 len: 1595 microversion: 2.20 time: 0.246041 Jul 05 20:55:28.892497 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 80/171] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 5 20:55:28 2022] GET /compute/v2.1/servers/52848078-62a1-484f-813c-7b3352cb3851 => generated 1595 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 20:55:28.912967 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-d4c91789-ec51-4fd6-95f0-0581ab13199d tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:55:28.913173 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-d4c91789-ec51-4fd6-95f0-0581ab13199d tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] [instance: 52848078-62a1-484f-813c-7b3352cb3851] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:55:28.920579 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-d4c91789-ec51-4fd6-95f0-0581ab13199d tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:55:28.921276 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-d4c91789-ec51-4fd6-95f0-0581ab13199d tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:55:28.922195 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-d4c91789-ec51-4fd6-95f0-0581ab13199d tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:55:28.922782 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-d4c91789-ec51-4fd6-95f0-0581ab13199d tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:55:29.013511 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-d4c91789-ec51-4fd6-95f0-0581ab13199d tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] 10.222.0.20 "GET /compute/v2.1/servers/52848078-62a1-484f-813c-7b3352cb3851/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.105115 Jul 05 20:55:29.014190 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 92/172] 10.222.0.20 () {60 vars in 1315 bytes} [Tue Jul 5 20:55:28 2022] GET /compute/v2.1/servers/52848078-62a1-484f-813c-7b3352cb3851/os-interface => generated 285 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 05 20:55:29.414006 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-7265e8e8-76e1-44aa-a009-38d74e6c0443 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:55:29.416197 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-7265e8e8-76e1-44aa-a009-38d74e6c0443 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] [instance: 82ec9293-050f-48f2-b0fd-e563145c6cb3] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:55:29.428871 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-7265e8e8-76e1-44aa-a009-38d74e6c0443 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:55:29.429498 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-7265e8e8-76e1-44aa-a009-38d74e6c0443 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:55:29.430512 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-7265e8e8-76e1-44aa-a009-38d74e6c0443 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:55:29.431048 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-7265e8e8-76e1-44aa-a009-38d74e6c0443 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:55:29.691526 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-4e89049e-2788-45d1-982f-752419105f1a tempest-DeleteServersTestJSON-389510094 tempest-DeleteServersTestJSON-389510094-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:55:29.693087 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-4e89049e-2788-45d1-982f-752419105f1a tempest-DeleteServersTestJSON-389510094 tempest-DeleteServersTestJSON-389510094-project] [instance: 1159954e-7c69-48d8-b051-5a7b1108da69] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:55:29.701835 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-4e89049e-2788-45d1-982f-752419105f1a tempest-DeleteServersTestJSON-389510094 tempest-DeleteServersTestJSON-389510094-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:55:29.702853 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-4e89049e-2788-45d1-982f-752419105f1a tempest-DeleteServersTestJSON-389510094 tempest-DeleteServersTestJSON-389510094-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:55:29.704102 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-4e89049e-2788-45d1-982f-752419105f1a tempest-DeleteServersTestJSON-389510094 tempest-DeleteServersTestJSON-389510094-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:55:29.705430 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-4e89049e-2788-45d1-982f-752419105f1a tempest-DeleteServersTestJSON-389510094 tempest-DeleteServersTestJSON-389510094-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:55:29.832164 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-7265e8e8-76e1-44aa-a009-38d74e6c0443 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd152763a64794301b21587ab2b395bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc6d47f96d17471d94367bc8f8a3e3f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:55:29.839884 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-7265e8e8-76e1-44aa-a009-38d74e6c0443 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] 10.222.0.20 "GET /compute/v2.1/servers/82ec9293-050f-48f2-b0fd-e563145c6cb3" status: 200 len: 1521 microversion: 2.1 time: 0.431973 Jul 05 20:55:29.840465 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 81/173] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:55:29 2022] GET /compute/v2.1/servers/82ec9293-050f-48f2-b0fd-e563145c6cb3 => generated 1521 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 20:55:30.068979 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-4e89049e-2788-45d1-982f-752419105f1a tempest-DeleteServersTestJSON-389510094 tempest-DeleteServersTestJSON-389510094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5063db22225a4d0b97ec5dcac8770045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '873a5ea6741e4762857e2bae05f5e06d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:55:30.077271 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-4e89049e-2788-45d1-982f-752419105f1a tempest-DeleteServersTestJSON-389510094 tempest-DeleteServersTestJSON-389510094-project] 10.222.0.20 "GET /compute/v2.1/servers/1159954e-7c69-48d8-b051-5a7b1108da69" status: 200 len: 1554 microversion: 2.1 time: 0.390758 Jul 05 20:55:30.077876 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 93/174] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:55:29 2022] GET /compute/v2.1/servers/1159954e-7c69-48d8-b051-5a7b1108da69 => generated 1554 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 20:55:30.341998 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [req-c2ba38c4-30e2-4e91-b228-a414666b482b req-1b3f9eb1-e03c-4d1a-b1d6-3ce4f10f91e5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f236112c-4649-478b-a626-b84f8ff1bfe9", "tag": "63ac1cb2-ef2b-47e3-9bb9-22cffd540dec"}]} {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 20:55:30.370795 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [req-c2ba38c4-30e2-4e91-b228-a414666b482b req-1b3f9eb1-e03c-4d1a-b1d6-3ce4f10f91e5 service nova] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:55:30.371423 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [req-c2ba38c4-30e2-4e91-b228-a414666b482b req-1b3f9eb1-e03c-4d1a-b1d6-3ce4f10f91e5 service nova] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:55:30.388204 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.compute.server_external_events [req-c2ba38c4-30e2-4e91-b228-a414666b482b req-1b3f9eb1-e03c-4d1a-b1d6-3ce4f10f91e5 service nova] Creating event network-changed:63ac1cb2-ef2b-47e3-9bb9-22cffd540dec for instance f236112c-4649-478b-a626-b84f8ff1bfe9 on hv-cinder-79760 Jul 05 20:55:30.399998 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [req-c2ba38c4-30e2-4e91-b228-a414666b482b req-1b3f9eb1-e03c-4d1a-b1d6-3ce4f10f91e5 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062592 Jul 05 20:55:30.401322 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 82/175] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 5 20:55:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 20:55:30.867548 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-34eb9f17-f4fe-4536-a521-23d19d4c9e7e tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:55:30.868252 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-34eb9f17-f4fe-4536-a521-23d19d4c9e7e tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] [instance: 82ec9293-050f-48f2-b0fd-e563145c6cb3] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:55:30.886940 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-34eb9f17-f4fe-4536-a521-23d19d4c9e7e tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:55:30.887628 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-34eb9f17-f4fe-4536-a521-23d19d4c9e7e tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:55:30.889102 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-34eb9f17-f4fe-4536-a521-23d19d4c9e7e tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:55:30.889719 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-34eb9f17-f4fe-4536-a521-23d19d4c9e7e tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:55:31.097138 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-5dec88b8-8dc0-4a5a-bb72-41177927350b tempest-DeleteServersTestJSON-389510094 tempest-DeleteServersTestJSON-389510094-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:55:31.099018 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-5dec88b8-8dc0-4a5a-bb72-41177927350b tempest-DeleteServersTestJSON-389510094 tempest-DeleteServersTestJSON-389510094-project] [instance: 1159954e-7c69-48d8-b051-5a7b1108da69] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:55:31.111945 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-5dec88b8-8dc0-4a5a-bb72-41177927350b tempest-DeleteServersTestJSON-389510094 tempest-DeleteServersTestJSON-389510094-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:55:31.112819 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-5dec88b8-8dc0-4a5a-bb72-41177927350b tempest-DeleteServersTestJSON-389510094 tempest-DeleteServersTestJSON-389510094-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:55:31.113872 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-5dec88b8-8dc0-4a5a-bb72-41177927350b tempest-DeleteServersTestJSON-389510094 tempest-DeleteServersTestJSON-389510094-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:55:31.114457 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-5dec88b8-8dc0-4a5a-bb72-41177927350b tempest-DeleteServersTestJSON-389510094 tempest-DeleteServersTestJSON-389510094-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:55:31.664997 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-34eb9f17-f4fe-4536-a521-23d19d4c9e7e tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd152763a64794301b21587ab2b395bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc6d47f96d17471d94367bc8f8a3e3f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:55:31.677930 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-34eb9f17-f4fe-4536-a521-23d19d4c9e7e tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] 10.222.0.20 "GET /compute/v2.1/servers/82ec9293-050f-48f2-b0fd-e563145c6cb3" status: 200 len: 1521 microversion: 2.1 time: 0.823022 Jul 05 20:55:31.680239 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 94/176] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:55:30 2022] GET /compute/v2.1/servers/82ec9293-050f-48f2-b0fd-e563145c6cb3 => generated 1521 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 20:55:31.686726 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [req-b5d7b065-ebe6-493b-af4e-912a3001dd4a req-a17b39f1-ea9b-4cae-b2c6-a938d73d45a4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "52848078-62a1-484f-813c-7b3352cb3851", "tag": "1f543410-d13c-44b8-9d38-5417d712191c"}]} {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 20:55:31.696602 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [req-b5d7b065-ebe6-493b-af4e-912a3001dd4a req-a17b39f1-ea9b-4cae-b2c6-a938d73d45a4 service nova] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:55:31.697402 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [req-b5d7b065-ebe6-493b-af4e-912a3001dd4a req-a17b39f1-ea9b-4cae-b2c6-a938d73d45a4 service nova] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:55:31.711451 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.compute.server_external_events [req-b5d7b065-ebe6-493b-af4e-912a3001dd4a req-a17b39f1-ea9b-4cae-b2c6-a938d73d45a4 service nova] Creating event network-changed:1f543410-d13c-44b8-9d38-5417d712191c for instance 52848078-62a1-484f-813c-7b3352cb3851 on hv-cinder-79760 Jul 05 20:55:31.724538 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [req-b5d7b065-ebe6-493b-af4e-912a3001dd4a req-a17b39f1-ea9b-4cae-b2c6-a938d73d45a4 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042037 Jul 05 20:55:31.725568 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 95/177] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 5 20:55:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 20:55:31.780331 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-5dec88b8-8dc0-4a5a-bb72-41177927350b tempest-DeleteServersTestJSON-389510094 tempest-DeleteServersTestJSON-389510094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5063db22225a4d0b97ec5dcac8770045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '873a5ea6741e4762857e2bae05f5e06d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:55:31.793657 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-5dec88b8-8dc0-4a5a-bb72-41177927350b tempest-DeleteServersTestJSON-389510094 tempest-DeleteServersTestJSON-389510094-project] 10.222.0.20 "GET /compute/v2.1/servers/1159954e-7c69-48d8-b051-5a7b1108da69" status: 200 len: 1554 microversion: 2.1 time: 0.702257 Jul 05 20:55:31.794706 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 83/178] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:55:31 2022] GET /compute/v2.1/servers/1159954e-7c69-48d8-b051-5a7b1108da69 => generated 1554 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 20:55:32.697639 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-83030e64-f891-4f97-a796-c9f4e06a34d9 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:55:32.698392 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-83030e64-f891-4f97-a796-c9f4e06a34d9 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] [instance: 82ec9293-050f-48f2-b0fd-e563145c6cb3] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:55:32.712391 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-83030e64-f891-4f97-a796-c9f4e06a34d9 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:55:32.712819 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-83030e64-f891-4f97-a796-c9f4e06a34d9 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:55:32.715824 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-83030e64-f891-4f97-a796-c9f4e06a34d9 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:55:32.716655 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-83030e64-f891-4f97-a796-c9f4e06a34d9 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:55:32.812576 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-d43a72e4-d171-4401-b402-b61d5ce339f5 tempest-DeleteServersTestJSON-389510094 tempest-DeleteServersTestJSON-389510094-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:55:32.814585 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-d43a72e4-d171-4401-b402-b61d5ce339f5 tempest-DeleteServersTestJSON-389510094 tempest-DeleteServersTestJSON-389510094-project] [instance: 1159954e-7c69-48d8-b051-5a7b1108da69] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:55:32.824600 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-d43a72e4-d171-4401-b402-b61d5ce339f5 tempest-DeleteServersTestJSON-389510094 tempest-DeleteServersTestJSON-389510094-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:55:32.825539 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-d43a72e4-d171-4401-b402-b61d5ce339f5 tempest-DeleteServersTestJSON-389510094 tempest-DeleteServersTestJSON-389510094-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:55:32.826667 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-d43a72e4-d171-4401-b402-b61d5ce339f5 tempest-DeleteServersTestJSON-389510094 tempest-DeleteServersTestJSON-389510094-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:55:32.827455 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-d43a72e4-d171-4401-b402-b61d5ce339f5 tempest-DeleteServersTestJSON-389510094 tempest-DeleteServersTestJSON-389510094-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:55:33.042074 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-d43a72e4-d171-4401-b402-b61d5ce339f5 tempest-DeleteServersTestJSON-389510094 tempest-DeleteServersTestJSON-389510094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5063db22225a4d0b97ec5dcac8770045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '873a5ea6741e4762857e2bae05f5e06d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:55:33.063678 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-d43a72e4-d171-4401-b402-b61d5ce339f5 tempest-DeleteServersTestJSON-389510094 tempest-DeleteServersTestJSON-389510094-project] 10.222.0.20 "GET /compute/v2.1/servers/1159954e-7c69-48d8-b051-5a7b1108da69" status: 200 len: 1346 microversion: 2.1 time: 0.255580 Jul 05 20:55:33.065715 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 84/179] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:55:32 2022] GET /compute/v2.1/servers/1159954e-7c69-48d8-b051-5a7b1108da69 => generated 1346 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 20:55:33.462465 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-83030e64-f891-4f97-a796-c9f4e06a34d9 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd152763a64794301b21587ab2b395bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc6d47f96d17471d94367bc8f8a3e3f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:55:33.471340 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-83030e64-f891-4f97-a796-c9f4e06a34d9 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] 10.222.0.20 "GET /compute/v2.1/servers/82ec9293-050f-48f2-b0fd-e563145c6cb3" status: 200 len: 1521 microversion: 2.1 time: 0.777967 Jul 05 20:55:33.480779 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 96/180] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:55:32 2022] GET /compute/v2.1/servers/82ec9293-050f-48f2-b0fd-e563145c6cb3 => generated 1521 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 20:55:33.756153 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [req-b32057c2-90b5-4357-a3fc-42120bd56b8b req-fcc5d905-f387-472e-b1a2-dda3278711da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1159954e-7c69-48d8-b051-5a7b1108da69", "name": "network-vif-deleted", "tag": "c23f1cb7-7c8c-45f8-b9aa-1642f642532e"}]} {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 20:55:33.765571 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [req-b32057c2-90b5-4357-a3fc-42120bd56b8b req-fcc5d905-f387-472e-b1a2-dda3278711da service nova] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:55:33.766066 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [req-b32057c2-90b5-4357-a3fc-42120bd56b8b req-fcc5d905-f387-472e-b1a2-dda3278711da service nova] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:55:33.780830 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.compute.server_external_events [req-b32057c2-90b5-4357-a3fc-42120bd56b8b req-fcc5d905-f387-472e-b1a2-dda3278711da service nova] Creating event network-vif-deleted:c23f1cb7-7c8c-45f8-b9aa-1642f642532e for instance 1159954e-7c69-48d8-b051-5a7b1108da69 on hv-cinder-79760 Jul 05 20:55:33.786777 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [req-b32057c2-90b5-4357-a3fc-42120bd56b8b req-fcc5d905-f387-472e-b1a2-dda3278711da service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035100 Jul 05 20:55:33.787572 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 85/181] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 5 20:55:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 05 20:55:34.082422 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-7a696aa1-d076-4e3e-99e5-cc4e76c44851 tempest-DeleteServersTestJSON-389510094 tempest-DeleteServersTestJSON-389510094-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:55:34.084242 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-7a696aa1-d076-4e3e-99e5-cc4e76c44851 tempest-DeleteServersTestJSON-389510094 tempest-DeleteServersTestJSON-389510094-project] [instance: 1159954e-7c69-48d8-b051-5a7b1108da69] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:55:34.108218 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-7a696aa1-d076-4e3e-99e5-cc4e76c44851 tempest-DeleteServersTestJSON-389510094 tempest-DeleteServersTestJSON-389510094-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:55:34.108656 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-7a696aa1-d076-4e3e-99e5-cc4e76c44851 tempest-DeleteServersTestJSON-389510094 tempest-DeleteServersTestJSON-389510094-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:55:34.109673 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-7a696aa1-d076-4e3e-99e5-cc4e76c44851 tempest-DeleteServersTestJSON-389510094 tempest-DeleteServersTestJSON-389510094-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:55:34.115013 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-7a696aa1-d076-4e3e-99e5-cc4e76c44851 tempest-DeleteServersTestJSON-389510094 tempest-DeleteServersTestJSON-389510094-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:55:34.132234 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.wsgi [None req-7a696aa1-d076-4e3e-99e5-cc4e76c44851 tempest-DeleteServersTestJSON-389510094 tempest-DeleteServersTestJSON-389510094-project] HTTP exception thrown: Instance 1159954e-7c69-48d8-b051-5a7b1108da69 could not be found. Jul 05 20:55:34.137480 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-7a696aa1-d076-4e3e-99e5-cc4e76c44851 tempest-DeleteServersTestJSON-389510094 tempest-DeleteServersTestJSON-389510094-project] Request method failure captured: Jul 05 20:55:34.137480 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: request: GET /compute/v2.1/servers/1159954e-7c69-48d8-b051-5a7b1108da69 HTTP/1.1 Jul 05 20:55:34.137480 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: Accept: application/json Jul 05 20:55:34.137480 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: Accept-Encoding: identity Jul 05 20:55:34.137480 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: Connection: close Jul 05 20:55:34.137480 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: Content-Length: 0 Jul 05 20:55:34.137480 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: Content-Type: application/json Jul 05 20:55:34.137480 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: Host: 10.222.0.20 Jul 05 20:55:34.137480 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: Openstack-System-Scope: None Jul 05 20:55:34.137480 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: User-Agent: python-urllib3/1.26.9 Jul 05 20:55:34.137480 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Auth-Token: gAAAAABixKT_N5im6CjaSTXLyF8AU-m_MERLxnFHiUO19bsOGsdZm9DT5VHR2MErvb3abFYfN0ZUQnVp0TpZ4RVtel5HDmaN2uHqHUNRWvNwgBI1B_KaOXYRL65cpiZwX7D4BL6ineTPDLsGfRXFxCQ2j5D0ObCaMCEG3ZK-1jBAYXyzkLV0aV4 Jul 05 20:55:34.137480 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Domain-Id: None Jul 05 20:55:34.137480 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Domain-Name: None Jul 05 20:55:34.137480 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Identity-Status: Confirmed Jul 05 20:55:34.137480 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Is-Admin-Project: True Jul 05 20:55:34.137480 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Project-Domain-Id: default Jul 05 20:55:34.137480 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Project-Domain-Name: Default Jul 05 20:55:34.137480 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Project-Id: 873a5ea6741e4762857e2bae05f5e06d Jul 05 20:55:34.137480 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Project-Name: tempest-DeleteServersTestJSON-389510094 Jul 05 20:55:34.137480 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Role: member,reader Jul 05 20:55:34.137480 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Roles: member,reader Jul 05 20:55:34.139069 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/873a5ea6741e4762857e2bae05f5e06d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/873a5ea6741e4762857e2bae05f5e06d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_873a5ea6741e4762857e2bae05f5e06d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/873a5ea6741e4762857e2bae05f5e06d"}]}] Jul 05 20:55:34.139069 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Tenant: tempest-DeleteServersTestJSON-389510094 Jul 05 20:55:34.139069 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Tenant-Id: 873a5ea6741e4762857e2bae05f5e06d Jul 05 20:55:34.139069 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Tenant-Name: tempest-DeleteServersTestJSON-389510094 Jul 05 20:55:34.139069 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-User: tempest-DeleteServersTestJSON-389510094-project Jul 05 20:55:34.139069 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-User-Domain-Id: default Jul 05 20:55:34.139069 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-User-Domain-Name: Default Jul 05 20:55:34.139069 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-User-Id: 5063db22225a4d0b97ec5dcac8770045 Jul 05 20:55:34.139069 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-User-Name: tempest-DeleteServersTestJSON-389510094-project Jul 05 20:55:34.139069 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: method: > Jul 05 20:55:34.139069 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: exception: Instance 1159954e-7c69-48d8-b051-5a7b1108da69 could not be found. Jul 05 20:55:34.139069 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: action_args: {'id': '1159954e-7c69-48d8-b051-5a7b1108da69'} Jul 05 20:55:34.139952 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 05 20:55:34.139952 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 20:55:34.139952 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 05 20:55:34.139952 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 05 20:55:34.139952 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 05 20:55:34.139952 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 05 20:55:34.139952 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 05 20:55:34.139952 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 05 20:55:34.139952 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 05 20:55:34.139952 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 05 20:55:34.139952 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1159954e-7c69-48d8-b051-5a7b1108da69 could not be found. Jul 05 20:55:34.139952 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi Jul 05 20:55:34.139952 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 20:55:34.139952 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi Jul 05 20:55:34.139952 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 20:55:34.139952 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 20:55:34.139952 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 20:55:34.139952 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 05 20:55:34.139952 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 05 20:55:34.139952 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 05 20:55:34.141602 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 05 20:55:34.141602 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 05 20:55:34.141602 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 05 20:55:34.141602 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 05 20:55:34.141602 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 05 20:55:34.141602 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 05 20:55:34.141602 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 05 20:55:34.141602 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1159954e-7c69-48d8-b051-5a7b1108da69 could not be found. Jul 05 20:55:34.141602 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi Jul 05 20:55:34.141602 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 20:55:34.141602 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi Jul 05 20:55:34.141602 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 20:55:34.141602 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 20:55:34.141602 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 20:55:34.141602 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 05 20:55:34.141602 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 05 20:55:34.141602 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1159954e-7c69-48d8-b051-5a7b1108da69 could not be found. Jul 05 20:55:34.141602 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi Jul 05 20:55:34.143156 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-7a696aa1-d076-4e3e-99e5-cc4e76c44851 tempest-DeleteServersTestJSON-389510094 tempest-DeleteServersTestJSON-389510094-project] Returning 404 to user: Instance 1159954e-7c69-48d8-b051-5a7b1108da69 could not be found. {{(pid=117628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 05 20:55:34.143156 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-7a696aa1-d076-4e3e-99e5-cc4e76c44851 tempest-DeleteServersTestJSON-389510094 tempest-DeleteServersTestJSON-389510094-project] 10.222.0.20 "GET /compute/v2.1/servers/1159954e-7c69-48d8-b051-5a7b1108da69" status: 404 len: 111 microversion: 2.1 time: 0.060347 Jul 05 20:55:34.143156 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 97/182] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:55:34 2022] GET /compute/v2.1/servers/1159954e-7c69-48d8-b051-5a7b1108da69 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 05 20:55:34.280772 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-b6294f89-936a-4317-8e2f-86d0d419bbb6 tempest-DeleteServersTestJSON-389510094 tempest-DeleteServersTestJSON-389510094-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:55:34.282474 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-b6294f89-936a-4317-8e2f-86d0d419bbb6 tempest-DeleteServersTestJSON-389510094 tempest-DeleteServersTestJSON-389510094-project] [instance: 1159954e-7c69-48d8-b051-5a7b1108da69] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:55:34.290389 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-b6294f89-936a-4317-8e2f-86d0d419bbb6 tempest-DeleteServersTestJSON-389510094 tempest-DeleteServersTestJSON-389510094-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:55:34.290838 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-b6294f89-936a-4317-8e2f-86d0d419bbb6 tempest-DeleteServersTestJSON-389510094 tempest-DeleteServersTestJSON-389510094-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:55:34.291609 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-b6294f89-936a-4317-8e2f-86d0d419bbb6 tempest-DeleteServersTestJSON-389510094 tempest-DeleteServersTestJSON-389510094-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:55:34.292035 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-b6294f89-936a-4317-8e2f-86d0d419bbb6 tempest-DeleteServersTestJSON-389510094 tempest-DeleteServersTestJSON-389510094-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:55:34.306278 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.wsgi [None req-b6294f89-936a-4317-8e2f-86d0d419bbb6 tempest-DeleteServersTestJSON-389510094 tempest-DeleteServersTestJSON-389510094-project] HTTP exception thrown: Instance 1159954e-7c69-48d8-b051-5a7b1108da69 could not be found. Jul 05 20:55:34.310494 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-b6294f89-936a-4317-8e2f-86d0d419bbb6 tempest-DeleteServersTestJSON-389510094 tempest-DeleteServersTestJSON-389510094-project] Request method failure captured: Jul 05 20:55:34.310494 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: request: GET /compute/v2.1/servers/1159954e-7c69-48d8-b051-5a7b1108da69/os-volume_attachments HTTP/1.1 Jul 05 20:55:34.310494 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: Accept: application/json Jul 05 20:55:34.310494 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: Accept-Encoding: identity Jul 05 20:55:34.310494 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: Connection: close Jul 05 20:55:34.310494 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: Content-Length: 0 Jul 05 20:55:34.310494 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: Content-Type: application/json Jul 05 20:55:34.310494 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: Host: 10.222.0.20 Jul 05 20:55:34.310494 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: Openstack-System-Scope: None Jul 05 20:55:34.310494 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: User-Agent: python-urllib3/1.26.9 Jul 05 20:55:34.310494 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Auth-Token: gAAAAABixKT_N5im6CjaSTXLyF8AU-m_MERLxnFHiUO19bsOGsdZm9DT5VHR2MErvb3abFYfN0ZUQnVp0TpZ4RVtel5HDmaN2uHqHUNRWvNwgBI1B_KaOXYRL65cpiZwX7D4BL6ineTPDLsGfRXFxCQ2j5D0ObCaMCEG3ZK-1jBAYXyzkLV0aV4 Jul 05 20:55:34.310494 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Domain-Id: None Jul 05 20:55:34.310494 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Domain-Name: None Jul 05 20:55:34.310494 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Identity-Status: Confirmed Jul 05 20:55:34.310494 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Is-Admin-Project: True Jul 05 20:55:34.310494 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Project-Domain-Id: default Jul 05 20:55:34.310494 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Project-Domain-Name: Default Jul 05 20:55:34.310494 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Project-Id: 873a5ea6741e4762857e2bae05f5e06d Jul 05 20:55:34.310494 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Project-Name: tempest-DeleteServersTestJSON-389510094 Jul 05 20:55:34.310494 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Role: member,reader Jul 05 20:55:34.310494 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Roles: member,reader Jul 05 20:55:34.311947 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/873a5ea6741e4762857e2bae05f5e06d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/873a5ea6741e4762857e2bae05f5e06d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_873a5ea6741e4762857e2bae05f5e06d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/873a5ea6741e4762857e2bae05f5e06d"}]}] Jul 05 20:55:34.311947 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Tenant: tempest-DeleteServersTestJSON-389510094 Jul 05 20:55:34.311947 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Tenant-Id: 873a5ea6741e4762857e2bae05f5e06d Jul 05 20:55:34.311947 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Tenant-Name: tempest-DeleteServersTestJSON-389510094 Jul 05 20:55:34.311947 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-User: tempest-DeleteServersTestJSON-389510094-project Jul 05 20:55:34.311947 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-User-Domain-Id: default Jul 05 20:55:34.311947 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-User-Domain-Name: Default Jul 05 20:55:34.311947 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-User-Id: 5063db22225a4d0b97ec5dcac8770045 Jul 05 20:55:34.311947 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-User-Name: tempest-DeleteServersTestJSON-389510094-project Jul 05 20:55:34.311947 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: method: > Jul 05 20:55:34.311947 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: exception: Instance 1159954e-7c69-48d8-b051-5a7b1108da69 could not be found. Jul 05 20:55:34.311947 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: action_args: {'server_id': '1159954e-7c69-48d8-b051-5a7b1108da69'} Jul 05 20:55:34.312767 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 05 20:55:34.312767 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 20:55:34.312767 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 05 20:55:34.312767 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 05 20:55:34.312767 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 05 20:55:34.312767 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 05 20:55:34.312767 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 05 20:55:34.312767 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 05 20:55:34.312767 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 05 20:55:34.312767 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 05 20:55:34.312767 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1159954e-7c69-48d8-b051-5a7b1108da69 could not be found. Jul 05 20:55:34.312767 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi Jul 05 20:55:34.312767 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 20:55:34.312767 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi Jul 05 20:55:34.312767 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 20:55:34.312767 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 20:55:34.312767 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 20:55:34.312767 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 05 20:55:34.312767 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 05 20:55:34.312767 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 05 20:55:34.318016 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 05 20:55:34.318016 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 05 20:55:34.318016 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 05 20:55:34.318016 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 05 20:55:34.318016 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 05 20:55:34.318016 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jul 05 20:55:34.318016 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jul 05 20:55:34.318016 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 05 20:55:34.318016 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 05 20:55:34.318016 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1159954e-7c69-48d8-b051-5a7b1108da69 could not be found. Jul 05 20:55:34.318016 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi Jul 05 20:55:34.318016 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 20:55:34.318016 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi Jul 05 20:55:34.318016 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 20:55:34.318016 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 20:55:34.318016 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 20:55:34.318016 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 05 20:55:34.318016 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 05 20:55:34.318016 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1159954e-7c69-48d8-b051-5a7b1108da69 could not be found. Jul 05 20:55:34.318016 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi Jul 05 20:55:34.319786 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-b6294f89-936a-4317-8e2f-86d0d419bbb6 tempest-DeleteServersTestJSON-389510094 tempest-DeleteServersTestJSON-389510094-project] Returning 404 to user: Instance 1159954e-7c69-48d8-b051-5a7b1108da69 could not be found. {{(pid=117627) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 05 20:55:34.319786 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-b6294f89-936a-4317-8e2f-86d0d419bbb6 tempest-DeleteServersTestJSON-389510094 tempest-DeleteServersTestJSON-389510094-project] 10.222.0.20 "GET /compute/v2.1/servers/1159954e-7c69-48d8-b051-5a7b1108da69/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.036448 Jul 05 20:55:34.319786 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 86/183] 10.222.0.20 () {58 vars in 1301 bytes} [Tue Jul 5 20:55:34 2022] GET /compute/v2.1/servers/1159954e-7c69-48d8-b051-5a7b1108da69/os-volume_attachments => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 05 20:55:34.487963 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-c54ac738-585f-45d8-bc51-b94c9b5d66d2 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:55:34.489069 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-c54ac738-585f-45d8-bc51-b94c9b5d66d2 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] [instance: 82ec9293-050f-48f2-b0fd-e563145c6cb3] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:55:34.495476 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-c54ac738-585f-45d8-bc51-b94c9b5d66d2 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:55:34.496338 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-c54ac738-585f-45d8-bc51-b94c9b5d66d2 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:55:34.497737 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-c54ac738-585f-45d8-bc51-b94c9b5d66d2 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:55:34.498417 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-c54ac738-585f-45d8-bc51-b94c9b5d66d2 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:55:34.677835 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-c54ac738-585f-45d8-bc51-b94c9b5d66d2 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd152763a64794301b21587ab2b395bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc6d47f96d17471d94367bc8f8a3e3f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:55:34.688511 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-c54ac738-585f-45d8-bc51-b94c9b5d66d2 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] 10.222.0.20 "GET /compute/v2.1/servers/82ec9293-050f-48f2-b0fd-e563145c6cb3" status: 200 len: 1521 microversion: 2.1 time: 0.204506 Jul 05 20:55:34.691045 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 98/184] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:55:34 2022] GET /compute/v2.1/servers/82ec9293-050f-48f2-b0fd-e563145c6cb3 => generated 1521 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 20:55:35.563391 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-2226b7d2-a72b-4f3c-9a8e-f6758a41e399 tempest-DeleteServersTestJSON-389510094 tempest-DeleteServersTestJSON-389510094-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:55:35.565027 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-2226b7d2-a72b-4f3c-9a8e-f6758a41e399 tempest-DeleteServersTestJSON-389510094 tempest-DeleteServersTestJSON-389510094-project] [instance: 1159954e-7c69-48d8-b051-5a7b1108da69] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:55:35.572451 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-2226b7d2-a72b-4f3c-9a8e-f6758a41e399 tempest-DeleteServersTestJSON-389510094 tempest-DeleteServersTestJSON-389510094-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:55:35.573170 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-2226b7d2-a72b-4f3c-9a8e-f6758a41e399 tempest-DeleteServersTestJSON-389510094 tempest-DeleteServersTestJSON-389510094-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:55:35.574367 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-2226b7d2-a72b-4f3c-9a8e-f6758a41e399 tempest-DeleteServersTestJSON-389510094 tempest-DeleteServersTestJSON-389510094-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:55:35.574953 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-2226b7d2-a72b-4f3c-9a8e-f6758a41e399 tempest-DeleteServersTestJSON-389510094 tempest-DeleteServersTestJSON-389510094-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:55:35.593586 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.wsgi [None req-2226b7d2-a72b-4f3c-9a8e-f6758a41e399 tempest-DeleteServersTestJSON-389510094 tempest-DeleteServersTestJSON-389510094-project] HTTP exception thrown: Instance 1159954e-7c69-48d8-b051-5a7b1108da69 could not be found. Jul 05 20:55:35.595731 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-2226b7d2-a72b-4f3c-9a8e-f6758a41e399 tempest-DeleteServersTestJSON-389510094 tempest-DeleteServersTestJSON-389510094-project] Request method failure captured: Jul 05 20:55:35.595731 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: request: DELETE /compute/v2.1/servers/1159954e-7c69-48d8-b051-5a7b1108da69 HTTP/1.1 Jul 05 20:55:35.595731 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: Accept: application/json Jul 05 20:55:35.595731 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: Accept-Encoding: identity Jul 05 20:55:35.595731 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: Connection: close Jul 05 20:55:35.595731 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: Content-Length: 0 Jul 05 20:55:35.595731 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: Content-Type: application/json Jul 05 20:55:35.595731 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: Host: 10.222.0.20 Jul 05 20:55:35.595731 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: Openstack-System-Scope: None Jul 05 20:55:35.595731 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: User-Agent: python-urllib3/1.26.9 Jul 05 20:55:35.595731 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Auth-Token: gAAAAABixKT_N5im6CjaSTXLyF8AU-m_MERLxnFHiUO19bsOGsdZm9DT5VHR2MErvb3abFYfN0ZUQnVp0TpZ4RVtel5HDmaN2uHqHUNRWvNwgBI1B_KaOXYRL65cpiZwX7D4BL6ineTPDLsGfRXFxCQ2j5D0ObCaMCEG3ZK-1jBAYXyzkLV0aV4 Jul 05 20:55:35.595731 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Domain-Id: None Jul 05 20:55:35.595731 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Domain-Name: None Jul 05 20:55:35.595731 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Identity-Status: Confirmed Jul 05 20:55:35.595731 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Is-Admin-Project: True Jul 05 20:55:35.595731 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Project-Domain-Id: default Jul 05 20:55:35.595731 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Project-Domain-Name: Default Jul 05 20:55:35.595731 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Project-Id: 873a5ea6741e4762857e2bae05f5e06d Jul 05 20:55:35.595731 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Project-Name: tempest-DeleteServersTestJSON-389510094 Jul 05 20:55:35.595731 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Role: member,reader Jul 05 20:55:35.595731 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Roles: member,reader Jul 05 20:55:35.597278 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/873a5ea6741e4762857e2bae05f5e06d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/873a5ea6741e4762857e2bae05f5e06d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_873a5ea6741e4762857e2bae05f5e06d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/873a5ea6741e4762857e2bae05f5e06d"}]}] Jul 05 20:55:35.597278 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Tenant: tempest-DeleteServersTestJSON-389510094 Jul 05 20:55:35.597278 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Tenant-Id: 873a5ea6741e4762857e2bae05f5e06d Jul 05 20:55:35.597278 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Tenant-Name: tempest-DeleteServersTestJSON-389510094 Jul 05 20:55:35.597278 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-User: tempest-DeleteServersTestJSON-389510094-project Jul 05 20:55:35.597278 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-User-Domain-Id: default Jul 05 20:55:35.597278 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-User-Domain-Name: Default Jul 05 20:55:35.597278 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-User-Id: 5063db22225a4d0b97ec5dcac8770045 Jul 05 20:55:35.597278 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-User-Name: tempest-DeleteServersTestJSON-389510094-project Jul 05 20:55:35.597278 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: method: > Jul 05 20:55:35.597278 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: exception: Instance 1159954e-7c69-48d8-b051-5a7b1108da69 could not be found. Jul 05 20:55:35.597278 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: action_args: {'id': '1159954e-7c69-48d8-b051-5a7b1108da69'} Jul 05 20:55:35.600970 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 05 20:55:35.600970 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 20:55:35.600970 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 05 20:55:35.600970 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 05 20:55:35.600970 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 05 20:55:35.600970 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 05 20:55:35.600970 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 05 20:55:35.600970 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 05 20:55:35.600970 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 05 20:55:35.600970 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 05 20:55:35.600970 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1159954e-7c69-48d8-b051-5a7b1108da69 could not be found. Jul 05 20:55:35.600970 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi Jul 05 20:55:35.600970 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 20:55:35.600970 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi Jul 05 20:55:35.600970 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 20:55:35.600970 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 20:55:35.600970 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 20:55:35.600970 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 05 20:55:35.600970 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 05 20:55:35.600970 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 05 20:55:35.602197 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 05 20:55:35.602197 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 05 20:55:35.602197 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 05 20:55:35.602197 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 05 20:55:35.602197 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 05 20:55:35.602197 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 05 20:55:35.602197 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 05 20:55:35.602197 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 05 20:55:35.602197 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 05 20:55:35.602197 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1159954e-7c69-48d8-b051-5a7b1108da69 could not be found. Jul 05 20:55:35.602197 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi Jul 05 20:55:35.602197 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 20:55:35.602197 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi Jul 05 20:55:35.602197 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 20:55:35.602197 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 20:55:35.602197 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 20:55:35.602197 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 05 20:55:35.602197 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 05 20:55:35.602197 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1159954e-7c69-48d8-b051-5a7b1108da69 could not be found. Jul 05 20:55:35.602197 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi Jul 05 20:55:35.603281 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-2226b7d2-a72b-4f3c-9a8e-f6758a41e399 tempest-DeleteServersTestJSON-389510094 tempest-DeleteServersTestJSON-389510094-project] Returning 404 to user: Instance 1159954e-7c69-48d8-b051-5a7b1108da69 could not be found. {{(pid=117627) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 05 20:55:35.603281 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-2226b7d2-a72b-4f3c-9a8e-f6758a41e399 tempest-DeleteServersTestJSON-389510094 tempest-DeleteServersTestJSON-389510094-project] 10.222.0.20 "DELETE /compute/v2.1/servers/1159954e-7c69-48d8-b051-5a7b1108da69" status: 404 len: 111 microversion: 2.1 time: 0.038104 Jul 05 20:55:35.603281 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 87/185] 10.222.0.20 () {58 vars in 1238 bytes} [Tue Jul 5 20:55:35 2022] DELETE /compute/v2.1/servers/1159954e-7c69-48d8-b051-5a7b1108da69 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 05 20:55:35.608698 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-2fa9eb50-e5f7-4ee8-b649-e79e00fcd963 tempest-DeleteServersTestJSON-389510094 tempest-DeleteServersTestJSON-389510094-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:55:35.609672 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-2fa9eb50-e5f7-4ee8-b649-e79e00fcd963 tempest-DeleteServersTestJSON-389510094 tempest-DeleteServersTestJSON-389510094-project] [instance: 1159954e-7c69-48d8-b051-5a7b1108da69] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:55:35.616882 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-2fa9eb50-e5f7-4ee8-b649-e79e00fcd963 tempest-DeleteServersTestJSON-389510094 tempest-DeleteServersTestJSON-389510094-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:55:35.617386 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-2fa9eb50-e5f7-4ee8-b649-e79e00fcd963 tempest-DeleteServersTestJSON-389510094 tempest-DeleteServersTestJSON-389510094-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:55:35.618160 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-2fa9eb50-e5f7-4ee8-b649-e79e00fcd963 tempest-DeleteServersTestJSON-389510094 tempest-DeleteServersTestJSON-389510094-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:55:35.618601 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-2fa9eb50-e5f7-4ee8-b649-e79e00fcd963 tempest-DeleteServersTestJSON-389510094 tempest-DeleteServersTestJSON-389510094-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:55:35.637557 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.wsgi [None req-2fa9eb50-e5f7-4ee8-b649-e79e00fcd963 tempest-DeleteServersTestJSON-389510094 tempest-DeleteServersTestJSON-389510094-project] HTTP exception thrown: Instance 1159954e-7c69-48d8-b051-5a7b1108da69 could not be found. Jul 05 20:55:35.639340 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-2fa9eb50-e5f7-4ee8-b649-e79e00fcd963 tempest-DeleteServersTestJSON-389510094 tempest-DeleteServersTestJSON-389510094-project] Request method failure captured: Jul 05 20:55:35.639340 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: request: GET /compute/v2.1/servers/1159954e-7c69-48d8-b051-5a7b1108da69 HTTP/1.1 Jul 05 20:55:35.639340 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: Accept: application/json Jul 05 20:55:35.639340 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: Accept-Encoding: identity Jul 05 20:55:35.639340 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: Connection: close Jul 05 20:55:35.639340 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: Content-Length: 0 Jul 05 20:55:35.639340 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: Content-Type: application/json Jul 05 20:55:35.639340 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: Host: 10.222.0.20 Jul 05 20:55:35.639340 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: Openstack-System-Scope: None Jul 05 20:55:35.639340 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: User-Agent: python-urllib3/1.26.9 Jul 05 20:55:35.639340 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Auth-Token: gAAAAABixKT_N5im6CjaSTXLyF8AU-m_MERLxnFHiUO19bsOGsdZm9DT5VHR2MErvb3abFYfN0ZUQnVp0TpZ4RVtel5HDmaN2uHqHUNRWvNwgBI1B_KaOXYRL65cpiZwX7D4BL6ineTPDLsGfRXFxCQ2j5D0ObCaMCEG3ZK-1jBAYXyzkLV0aV4 Jul 05 20:55:35.639340 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Domain-Id: None Jul 05 20:55:35.639340 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Domain-Name: None Jul 05 20:55:35.639340 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Identity-Status: Confirmed Jul 05 20:55:35.639340 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Is-Admin-Project: True Jul 05 20:55:35.639340 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Project-Domain-Id: default Jul 05 20:55:35.639340 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Project-Domain-Name: Default Jul 05 20:55:35.639340 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Project-Id: 873a5ea6741e4762857e2bae05f5e06d Jul 05 20:55:35.639340 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Project-Name: tempest-DeleteServersTestJSON-389510094 Jul 05 20:55:35.639340 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Role: member,reader Jul 05 20:55:35.639340 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Roles: member,reader Jul 05 20:55:35.640588 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/873a5ea6741e4762857e2bae05f5e06d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/873a5ea6741e4762857e2bae05f5e06d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_873a5ea6741e4762857e2bae05f5e06d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/873a5ea6741e4762857e2bae05f5e06d"}]}] Jul 05 20:55:35.640588 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Tenant: tempest-DeleteServersTestJSON-389510094 Jul 05 20:55:35.640588 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Tenant-Id: 873a5ea6741e4762857e2bae05f5e06d Jul 05 20:55:35.640588 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Tenant-Name: tempest-DeleteServersTestJSON-389510094 Jul 05 20:55:35.640588 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-User: tempest-DeleteServersTestJSON-389510094-project Jul 05 20:55:35.640588 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-User-Domain-Id: default Jul 05 20:55:35.640588 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-User-Domain-Name: Default Jul 05 20:55:35.640588 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-User-Id: 5063db22225a4d0b97ec5dcac8770045 Jul 05 20:55:35.640588 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-User-Name: tempest-DeleteServersTestJSON-389510094-project Jul 05 20:55:35.640588 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: method: > Jul 05 20:55:35.640588 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: exception: Instance 1159954e-7c69-48d8-b051-5a7b1108da69 could not be found. Jul 05 20:55:35.640588 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: action_args: {'id': '1159954e-7c69-48d8-b051-5a7b1108da69'} Jul 05 20:55:35.641798 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 05 20:55:35.641798 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 20:55:35.641798 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 05 20:55:35.641798 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 05 20:55:35.641798 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 05 20:55:35.641798 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 05 20:55:35.641798 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 05 20:55:35.641798 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 05 20:55:35.641798 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 05 20:55:35.641798 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 05 20:55:35.641798 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1159954e-7c69-48d8-b051-5a7b1108da69 could not be found. Jul 05 20:55:35.641798 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi Jul 05 20:55:35.641798 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 20:55:35.641798 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi Jul 05 20:55:35.641798 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 20:55:35.641798 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 20:55:35.641798 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 20:55:35.641798 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 05 20:55:35.641798 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 05 20:55:35.641798 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 05 20:55:35.643938 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 05 20:55:35.643938 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 05 20:55:35.643938 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 05 20:55:35.643938 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 05 20:55:35.643938 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 05 20:55:35.643938 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 05 20:55:35.643938 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 05 20:55:35.643938 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1159954e-7c69-48d8-b051-5a7b1108da69 could not be found. Jul 05 20:55:35.643938 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi Jul 05 20:55:35.643938 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 20:55:35.643938 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi Jul 05 20:55:35.643938 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 20:55:35.643938 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 20:55:35.643938 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 20:55:35.643938 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 05 20:55:35.643938 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 05 20:55:35.643938 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1159954e-7c69-48d8-b051-5a7b1108da69 could not be found. Jul 05 20:55:35.643938 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi Jul 05 20:55:35.645315 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-2fa9eb50-e5f7-4ee8-b649-e79e00fcd963 tempest-DeleteServersTestJSON-389510094 tempest-DeleteServersTestJSON-389510094-project] Returning 404 to user: Instance 1159954e-7c69-48d8-b051-5a7b1108da69 could not be found. {{(pid=117628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 05 20:55:35.645315 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-2fa9eb50-e5f7-4ee8-b649-e79e00fcd963 tempest-DeleteServersTestJSON-389510094 tempest-DeleteServersTestJSON-389510094-project] 10.222.0.20 "GET /compute/v2.1/servers/1159954e-7c69-48d8-b051-5a7b1108da69" status: 404 len: 111 microversion: 2.1 time: 0.035811 Jul 05 20:55:35.645315 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 99/186] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:55:35 2022] GET /compute/v2.1/servers/1159954e-7c69-48d8-b051-5a7b1108da69 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 05 20:55:35.707929 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-9ee27cb9-1a88-4a55-9c3a-08056f72a4d2 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:55:35.708536 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-9ee27cb9-1a88-4a55-9c3a-08056f72a4d2 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] [instance: 82ec9293-050f-48f2-b0fd-e563145c6cb3] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:55:35.714723 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-9ee27cb9-1a88-4a55-9c3a-08056f72a4d2 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:55:35.715196 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-9ee27cb9-1a88-4a55-9c3a-08056f72a4d2 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:55:35.716009 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-9ee27cb9-1a88-4a55-9c3a-08056f72a4d2 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:55:35.716716 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-9ee27cb9-1a88-4a55-9c3a-08056f72a4d2 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:55:36.045547 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-9ee27cb9-1a88-4a55-9c3a-08056f72a4d2 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd152763a64794301b21587ab2b395bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc6d47f96d17471d94367bc8f8a3e3f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:55:36.054714 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG dbcounter [-] [117627] Writing DB stats nova_cell1:SELECT=100 {{(pid=117627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:55:36.058184 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-9ee27cb9-1a88-4a55-9c3a-08056f72a4d2 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] 10.222.0.20 "GET /compute/v2.1/servers/82ec9293-050f-48f2-b0fd-e563145c6cb3" status: 200 len: 1521 microversion: 2.1 time: 0.354687 Jul 05 20:55:36.058976 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 88/187] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:55:35 2022] GET /compute/v2.1/servers/82ec9293-050f-48f2-b0fd-e563145c6cb3 => generated 1521 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 20:55:37.077964 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-66b30b43-e649-41c4-8898-ed9a99cbfb31 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:55:37.079507 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-66b30b43-e649-41c4-8898-ed9a99cbfb31 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] [instance: 82ec9293-050f-48f2-b0fd-e563145c6cb3] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:55:37.087063 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-66b30b43-e649-41c4-8898-ed9a99cbfb31 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:55:37.087517 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-66b30b43-e649-41c4-8898-ed9a99cbfb31 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:55:37.088243 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-66b30b43-e649-41c4-8898-ed9a99cbfb31 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:55:37.088764 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-66b30b43-e649-41c4-8898-ed9a99cbfb31 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:55:37.447223 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-66b30b43-e649-41c4-8898-ed9a99cbfb31 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd152763a64794301b21587ab2b395bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc6d47f96d17471d94367bc8f8a3e3f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:55:37.458817 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-66b30b43-e649-41c4-8898-ed9a99cbfb31 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] 10.222.0.20 "GET /compute/v2.1/servers/82ec9293-050f-48f2-b0fd-e563145c6cb3" status: 200 len: 1521 microversion: 2.1 time: 0.384509 Jul 05 20:55:37.469049 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 100/188] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:55:37 2022] GET /compute/v2.1/servers/82ec9293-050f-48f2-b0fd-e563145c6cb3 => generated 1521 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 20:55:38.489994 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-ce859b21-fd5f-4e39-86a4-25612bba5b0f tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:55:38.497633 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-ce859b21-fd5f-4e39-86a4-25612bba5b0f tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] [instance: 82ec9293-050f-48f2-b0fd-e563145c6cb3] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:55:38.525812 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-ce859b21-fd5f-4e39-86a4-25612bba5b0f tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:55:38.527526 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-ce859b21-fd5f-4e39-86a4-25612bba5b0f tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:55:38.528385 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-ce859b21-fd5f-4e39-86a4-25612bba5b0f tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:55:38.533670 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-ce859b21-fd5f-4e39-86a4-25612bba5b0f tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:55:38.959207 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-ce859b21-fd5f-4e39-86a4-25612bba5b0f tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd152763a64794301b21587ab2b395bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc6d47f96d17471d94367bc8f8a3e3f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:55:38.968427 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-ce859b21-fd5f-4e39-86a4-25612bba5b0f tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] 10.222.0.20 "GET /compute/v2.1/servers/82ec9293-050f-48f2-b0fd-e563145c6cb3" status: 200 len: 1521 microversion: 2.1 time: 0.495596 Jul 05 20:55:38.969350 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 89/189] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:55:38 2022] GET /compute/v2.1/servers/82ec9293-050f-48f2-b0fd-e563145c6cb3 => generated 1521 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 20:55:39.985844 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-6b527a42-2197-463b-ba69-223f418b9af8 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:55:39.986518 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-6b527a42-2197-463b-ba69-223f418b9af8 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] [instance: 82ec9293-050f-48f2-b0fd-e563145c6cb3] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:55:39.993730 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-6b527a42-2197-463b-ba69-223f418b9af8 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:55:39.994482 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-6b527a42-2197-463b-ba69-223f418b9af8 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:55:39.995652 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-6b527a42-2197-463b-ba69-223f418b9af8 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:55:39.996167 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-6b527a42-2197-463b-ba69-223f418b9af8 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:55:40.146999 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-6b527a42-2197-463b-ba69-223f418b9af8 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd152763a64794301b21587ab2b395bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc6d47f96d17471d94367bc8f8a3e3f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:55:40.160719 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-6b527a42-2197-463b-ba69-223f418b9af8 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] 10.222.0.20 "GET /compute/v2.1/servers/82ec9293-050f-48f2-b0fd-e563145c6cb3" status: 200 len: 1521 microversion: 2.1 time: 0.179347 Jul 05 20:55:40.161438 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 101/190] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:55:39 2022] GET /compute/v2.1/servers/82ec9293-050f-48f2-b0fd-e563145c6cb3 => generated 1521 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 20:55:41.186637 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-38a9b154-b5c7-4714-a2f0-dea0853800b2 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:55:41.188105 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-38a9b154-b5c7-4714-a2f0-dea0853800b2 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] [instance: 82ec9293-050f-48f2-b0fd-e563145c6cb3] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:55:41.218440 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-38a9b154-b5c7-4714-a2f0-dea0853800b2 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:55:41.219207 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-38a9b154-b5c7-4714-a2f0-dea0853800b2 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:55:41.220087 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-38a9b154-b5c7-4714-a2f0-dea0853800b2 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:55:41.220680 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-38a9b154-b5c7-4714-a2f0-dea0853800b2 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:55:41.539621 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-38a9b154-b5c7-4714-a2f0-dea0853800b2 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd152763a64794301b21587ab2b395bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc6d47f96d17471d94367bc8f8a3e3f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:55:41.566968 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-38a9b154-b5c7-4714-a2f0-dea0853800b2 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] 10.222.0.20 "GET /compute/v2.1/servers/82ec9293-050f-48f2-b0fd-e563145c6cb3" status: 200 len: 1521 microversion: 2.1 time: 0.388960 Jul 05 20:55:41.585800 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 90/191] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:55:41 2022] GET /compute/v2.1/servers/82ec9293-050f-48f2-b0fd-e563145c6cb3 => generated 1521 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 20:55:42.604282 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-86561529-7a70-4e63-913e-0130b8e0058c tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:55:42.604889 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-86561529-7a70-4e63-913e-0130b8e0058c tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] [instance: 82ec9293-050f-48f2-b0fd-e563145c6cb3] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:55:42.613474 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-86561529-7a70-4e63-913e-0130b8e0058c tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:55:42.614170 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-86561529-7a70-4e63-913e-0130b8e0058c tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:55:42.615308 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-86561529-7a70-4e63-913e-0130b8e0058c tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:55:42.616022 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-86561529-7a70-4e63-913e-0130b8e0058c tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:55:42.939392 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-86561529-7a70-4e63-913e-0130b8e0058c tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd152763a64794301b21587ab2b395bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc6d47f96d17471d94367bc8f8a3e3f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:55:42.950644 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-86561529-7a70-4e63-913e-0130b8e0058c tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] 10.222.0.20 "GET /compute/v2.1/servers/82ec9293-050f-48f2-b0fd-e563145c6cb3" status: 200 len: 1521 microversion: 2.1 time: 0.357083 Jul 05 20:55:42.953906 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 102/192] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:55:42 2022] GET /compute/v2.1/servers/82ec9293-050f-48f2-b0fd-e563145c6cb3 => generated 1521 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 20:55:43.971496 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-a5c098ef-7486-4961-a9a1-c2bb868acfac tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:55:43.972105 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-a5c098ef-7486-4961-a9a1-c2bb868acfac tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] [instance: 82ec9293-050f-48f2-b0fd-e563145c6cb3] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:55:43.975876 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG dbcounter [-] [117627] Writing DB stats nova_api:SELECT=70 {{(pid=117627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:55:43.996704 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-a5c098ef-7486-4961-a9a1-c2bb868acfac tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:55:43.997935 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-a5c098ef-7486-4961-a9a1-c2bb868acfac tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:55:44.002993 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-a5c098ef-7486-4961-a9a1-c2bb868acfac tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:55:44.003927 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-a5c098ef-7486-4961-a9a1-c2bb868acfac tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:55:44.371483 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-a5c098ef-7486-4961-a9a1-c2bb868acfac tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd152763a64794301b21587ab2b395bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc6d47f96d17471d94367bc8f8a3e3f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:55:44.383622 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-a5c098ef-7486-4961-a9a1-c2bb868acfac tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] 10.222.0.20 "GET /compute/v2.1/servers/82ec9293-050f-48f2-b0fd-e563145c6cb3" status: 200 len: 1521 microversion: 2.1 time: 0.416854 Jul 05 20:55:44.383852 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 91/193] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:55:43 2022] GET /compute/v2.1/servers/82ec9293-050f-48f2-b0fd-e563145c6cb3 => generated 1521 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 20:55:45.402699 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-ede4fc53-057a-4915-b92b-0d01745b062c tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:55:45.403312 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-ede4fc53-057a-4915-b92b-0d01745b062c tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] [instance: 82ec9293-050f-48f2-b0fd-e563145c6cb3] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:55:45.418920 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-ede4fc53-057a-4915-b92b-0d01745b062c tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:55:45.419366 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-ede4fc53-057a-4915-b92b-0d01745b062c tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:55:45.428704 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-ede4fc53-057a-4915-b92b-0d01745b062c tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:55:45.428704 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-ede4fc53-057a-4915-b92b-0d01745b062c tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:55:45.429587 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG dbcounter [-] [117628] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:55:45.724093 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-ede4fc53-057a-4915-b92b-0d01745b062c tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd152763a64794301b21587ab2b395bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc6d47f96d17471d94367bc8f8a3e3f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:55:45.732773 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-ede4fc53-057a-4915-b92b-0d01745b062c tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] 10.222.0.20 "GET /compute/v2.1/servers/82ec9293-050f-48f2-b0fd-e563145c6cb3" status: 200 len: 1521 microversion: 2.1 time: 0.334038 Jul 05 20:55:45.737273 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 103/194] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:55:45 2022] GET /compute/v2.1/servers/82ec9293-050f-48f2-b0fd-e563145c6cb3 => generated 1521 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 20:55:46.763798 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-69151079-4856-4a25-86e2-6e635ed6362c tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:55:46.765114 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-69151079-4856-4a25-86e2-6e635ed6362c tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] [instance: 82ec9293-050f-48f2-b0fd-e563145c6cb3] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:55:46.778472 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-69151079-4856-4a25-86e2-6e635ed6362c tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:55:46.780554 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-69151079-4856-4a25-86e2-6e635ed6362c tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:55:46.782528 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-69151079-4856-4a25-86e2-6e635ed6362c tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:55:46.784656 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-69151079-4856-4a25-86e2-6e635ed6362c tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:55:47.275287 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-69151079-4856-4a25-86e2-6e635ed6362c tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd152763a64794301b21587ab2b395bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc6d47f96d17471d94367bc8f8a3e3f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:55:47.288228 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-69151079-4856-4a25-86e2-6e635ed6362c tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] 10.222.0.20 "GET /compute/v2.1/servers/82ec9293-050f-48f2-b0fd-e563145c6cb3" status: 200 len: 1521 microversion: 2.1 time: 0.534413 Jul 05 20:55:47.289283 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 92/195] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:55:46 2022] GET /compute/v2.1/servers/82ec9293-050f-48f2-b0fd-e563145c6cb3 => generated 1521 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 20:55:48.307310 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-522f13e5-87a1-489f-a0b5-0684249d017b tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:55:48.309840 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-522f13e5-87a1-489f-a0b5-0684249d017b tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] [instance: 82ec9293-050f-48f2-b0fd-e563145c6cb3] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:55:48.327666 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-522f13e5-87a1-489f-a0b5-0684249d017b tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:55:48.328124 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-522f13e5-87a1-489f-a0b5-0684249d017b tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:55:48.329011 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-522f13e5-87a1-489f-a0b5-0684249d017b tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:55:48.329683 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-522f13e5-87a1-489f-a0b5-0684249d017b tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:55:48.799432 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-522f13e5-87a1-489f-a0b5-0684249d017b tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd152763a64794301b21587ab2b395bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc6d47f96d17471d94367bc8f8a3e3f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:55:48.807970 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-522f13e5-87a1-489f-a0b5-0684249d017b tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] 10.222.0.20 "GET /compute/v2.1/servers/82ec9293-050f-48f2-b0fd-e563145c6cb3" status: 200 len: 1521 microversion: 2.1 time: 0.505740 Jul 05 20:55:48.810723 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 104/196] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:55:48 2022] GET /compute/v2.1/servers/82ec9293-050f-48f2-b0fd-e563145c6cb3 => generated 1521 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 20:55:49.831272 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-eed704dc-da5e-4c03-8132-dc78bcf5cd58 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:55:49.833312 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-eed704dc-da5e-4c03-8132-dc78bcf5cd58 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] [instance: 82ec9293-050f-48f2-b0fd-e563145c6cb3] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:55:49.850249 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-eed704dc-da5e-4c03-8132-dc78bcf5cd58 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:55:49.851045 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-eed704dc-da5e-4c03-8132-dc78bcf5cd58 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:55:49.852507 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-eed704dc-da5e-4c03-8132-dc78bcf5cd58 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:55:49.853262 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-eed704dc-da5e-4c03-8132-dc78bcf5cd58 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:55:50.093248 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-eed704dc-da5e-4c03-8132-dc78bcf5cd58 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd152763a64794301b21587ab2b395bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc6d47f96d17471d94367bc8f8a3e3f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:55:50.101929 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-eed704dc-da5e-4c03-8132-dc78bcf5cd58 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] 10.222.0.20 "GET /compute/v2.1/servers/82ec9293-050f-48f2-b0fd-e563145c6cb3" status: 200 len: 1521 microversion: 2.1 time: 0.277754 Jul 05 20:55:50.124847 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 93/197] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:55:49 2022] GET /compute/v2.1/servers/82ec9293-050f-48f2-b0fd-e563145c6cb3 => generated 1521 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 20:55:50.733805 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-e9d1980e-8cb2-4d83-a820-a4d6a6d14628 tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Action: 'create', calling method: .version_select at 0x7f57ce10a430>, body: {"keypair": {"name": "tempest-TestShelveInstance-672009384", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO0Ye74ku1dto+LWPA+dnh9EMZsKci07bP0jvomV1W8v4i1FK1IiAoiXAg524IEAYCrPNBaMrSNKFLlUvqmAyncL51WfbNiqBV+8msHS6TXdl4DVBCULvesjPzjf4ZSObA=="}} {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 20:55:50.771210 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.quota [None req-e9d1980e-8cb2-4d83-a820-a4d6a6d14628 tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Getting quotas for project 3429e99ac2a94266b152e053bc6a0006. Resources: {'key_pairs'} {{(pid=117628) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 05 20:55:50.784655 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.quota [None req-e9d1980e-8cb2-4d83-a820-a4d6a6d14628 tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Getting quotas for user 7a4b471d14044069a5969e8bc6ca4f2d and project 3429e99ac2a94266b152e053bc6a0006. Resources: {'key_pairs'} {{(pid=117628) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 05 20:55:50.842914 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-e9d1980e-8cb2-4d83-a820-a4d6a6d14628 tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.539624 Jul 05 20:55:50.843556 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 105/198] 10.222.0.20 () {60 vars in 1158 bytes} [Tue Jul 5 20:55:50 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 20:55:51.118261 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-fc43a8d7-c03e-4914-9120-75e36f38f4b4 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:55:51.119014 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-fc43a8d7-c03e-4914-9120-75e36f38f4b4 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] [instance: 82ec9293-050f-48f2-b0fd-e563145c6cb3] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:55:51.126454 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-fc43a8d7-c03e-4914-9120-75e36f38f4b4 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:55:51.127156 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-fc43a8d7-c03e-4914-9120-75e36f38f4b4 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:55:51.128197 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-fc43a8d7-c03e-4914-9120-75e36f38f4b4 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:55:51.128893 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-fc43a8d7-c03e-4914-9120-75e36f38f4b4 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:55:51.295470 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-fc43a8d7-c03e-4914-9120-75e36f38f4b4 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd152763a64794301b21587ab2b395bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc6d47f96d17471d94367bc8f8a3e3f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:55:51.303755 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-fc43a8d7-c03e-4914-9120-75e36f38f4b4 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] 10.222.0.20 "GET /compute/v2.1/servers/82ec9293-050f-48f2-b0fd-e563145c6cb3" status: 200 len: 1521 microversion: 2.1 time: 0.189378 Jul 05 20:55:51.304353 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 94/199] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:55:51 2022] GET /compute/v2.1/servers/82ec9293-050f-48f2-b0fd-e563145c6cb3 => generated 1521 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 20:55:52.320396 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-44963ebc-8286-4237-a4ad-3f155f6fb91f tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:55:52.321033 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-44963ebc-8286-4237-a4ad-3f155f6fb91f tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] [instance: 82ec9293-050f-48f2-b0fd-e563145c6cb3] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:55:52.327871 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-44963ebc-8286-4237-a4ad-3f155f6fb91f tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:55:52.328371 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-44963ebc-8286-4237-a4ad-3f155f6fb91f tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:55:52.329239 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-44963ebc-8286-4237-a4ad-3f155f6fb91f tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:55:52.329782 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-44963ebc-8286-4237-a4ad-3f155f6fb91f tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:55:52.501532 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-44963ebc-8286-4237-a4ad-3f155f6fb91f tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd152763a64794301b21587ab2b395bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc6d47f96d17471d94367bc8f8a3e3f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:55:52.510676 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-44963ebc-8286-4237-a4ad-3f155f6fb91f tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] 10.222.0.20 "GET /compute/v2.1/servers/82ec9293-050f-48f2-b0fd-e563145c6cb3" status: 200 len: 1521 microversion: 2.1 time: 0.194402 Jul 05 20:55:52.511194 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 106/200] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:55:52 2022] GET /compute/v2.1/servers/82ec9293-050f-48f2-b0fd-e563145c6cb3 => generated 1521 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 20:55:53.527852 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-2043bd57-d99d-4048-b213-a763ef5d3354 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:55:53.528568 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-2043bd57-d99d-4048-b213-a763ef5d3354 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] [instance: 82ec9293-050f-48f2-b0fd-e563145c6cb3] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:55:53.536261 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-2043bd57-d99d-4048-b213-a763ef5d3354 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:55:53.536802 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-2043bd57-d99d-4048-b213-a763ef5d3354 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:55:53.537653 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-2043bd57-d99d-4048-b213-a763ef5d3354 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:55:53.538145 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-2043bd57-d99d-4048-b213-a763ef5d3354 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:55:53.677242 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-2043bd57-d99d-4048-b213-a763ef5d3354 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd152763a64794301b21587ab2b395bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc6d47f96d17471d94367bc8f8a3e3f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:55:53.693009 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-2043bd57-d99d-4048-b213-a763ef5d3354 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] 10.222.0.20 "GET /compute/v2.1/servers/82ec9293-050f-48f2-b0fd-e563145c6cb3" status: 200 len: 1521 microversion: 2.1 time: 0.169058 Jul 05 20:55:53.693698 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 95/201] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:55:53 2022] GET /compute/v2.1/servers/82ec9293-050f-48f2-b0fd-e563145c6cb3 => generated 1521 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 20:55:54.713733 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-8736dec3-ea7c-4c31-ad6d-802f572aa790 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:55:54.715438 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-8736dec3-ea7c-4c31-ad6d-802f572aa790 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] [instance: 82ec9293-050f-48f2-b0fd-e563145c6cb3] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:55:54.726178 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-8736dec3-ea7c-4c31-ad6d-802f572aa790 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:55:54.726629 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-8736dec3-ea7c-4c31-ad6d-802f572aa790 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:55:54.727398 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-8736dec3-ea7c-4c31-ad6d-802f572aa790 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:55:54.727823 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-8736dec3-ea7c-4c31-ad6d-802f572aa790 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:55:54.875880 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-8736dec3-ea7c-4c31-ad6d-802f572aa790 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd152763a64794301b21587ab2b395bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc6d47f96d17471d94367bc8f8a3e3f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:55:54.884532 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-8736dec3-ea7c-4c31-ad6d-802f572aa790 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] 10.222.0.20 "GET /compute/v2.1/servers/82ec9293-050f-48f2-b0fd-e563145c6cb3" status: 200 len: 1521 microversion: 2.1 time: 0.178284 Jul 05 20:55:54.885264 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 107/202] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:55:54 2022] GET /compute/v2.1/servers/82ec9293-050f-48f2-b0fd-e563145c6cb3 => generated 1521 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 20:55:55.902879 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-abf5c0bc-3563-472b-936f-155d866103b7 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:55:55.903489 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-abf5c0bc-3563-472b-936f-155d866103b7 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] [instance: 82ec9293-050f-48f2-b0fd-e563145c6cb3] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:55:55.910526 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-abf5c0bc-3563-472b-936f-155d866103b7 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:55:55.910965 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-abf5c0bc-3563-472b-936f-155d866103b7 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:55:55.911716 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-abf5c0bc-3563-472b-936f-155d866103b7 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:55:55.912144 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-abf5c0bc-3563-472b-936f-155d866103b7 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:55:56.052518 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-abf5c0bc-3563-472b-936f-155d866103b7 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd152763a64794301b21587ab2b395bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc6d47f96d17471d94367bc8f8a3e3f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:55:56.060126 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-abf5c0bc-3563-472b-936f-155d866103b7 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] 10.222.0.20 "GET /compute/v2.1/servers/82ec9293-050f-48f2-b0fd-e563145c6cb3" status: 200 len: 1521 microversion: 2.1 time: 0.161354 Jul 05 20:55:56.060682 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 96/203] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:55:55 2022] GET /compute/v2.1/servers/82ec9293-050f-48f2-b0fd-e563145c6cb3 => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 20:55:57.077073 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-e5e3c068-3a1f-4e5c-9b57-8660116db7ba tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:55:57.077768 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-e5e3c068-3a1f-4e5c-9b57-8660116db7ba tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] [instance: 82ec9293-050f-48f2-b0fd-e563145c6cb3] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:55:57.080446 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG dbcounter [-] [117628] Writing DB stats nova_api:SELECT=51,nova_api:INSERT=1 {{(pid=117628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:55:57.086856 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-e5e3c068-3a1f-4e5c-9b57-8660116db7ba tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:55:57.087328 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-e5e3c068-3a1f-4e5c-9b57-8660116db7ba tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:55:57.088206 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-e5e3c068-3a1f-4e5c-9b57-8660116db7ba tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:55:57.088637 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-e5e3c068-3a1f-4e5c-9b57-8660116db7ba tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:55:57.228446 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-e5e3c068-3a1f-4e5c-9b57-8660116db7ba tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd152763a64794301b21587ab2b395bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc6d47f96d17471d94367bc8f8a3e3f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:55:57.236674 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-e5e3c068-3a1f-4e5c-9b57-8660116db7ba tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] 10.222.0.20 "GET /compute/v2.1/servers/82ec9293-050f-48f2-b0fd-e563145c6cb3" status: 200 len: 1521 microversion: 2.1 time: 0.163690 Jul 05 20:55:57.237276 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 108/204] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:55:57 2022] GET /compute/v2.1/servers/82ec9293-050f-48f2-b0fd-e563145c6cb3 => generated 1521 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 20:55:58.254208 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-7a40a997-0833-4244-80f2-12e04b1a3637 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:55:58.255564 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-7a40a997-0833-4244-80f2-12e04b1a3637 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] [instance: 82ec9293-050f-48f2-b0fd-e563145c6cb3] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:55:58.269782 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-7a40a997-0833-4244-80f2-12e04b1a3637 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:55:58.270482 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-7a40a997-0833-4244-80f2-12e04b1a3637 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:55:58.271458 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-7a40a997-0833-4244-80f2-12e04b1a3637 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:55:58.272074 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-7a40a997-0833-4244-80f2-12e04b1a3637 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:55:58.435636 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-7a40a997-0833-4244-80f2-12e04b1a3637 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd152763a64794301b21587ab2b395bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc6d47f96d17471d94367bc8f8a3e3f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:55:58.445266 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-7a40a997-0833-4244-80f2-12e04b1a3637 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] 10.222.0.20 "GET /compute/v2.1/servers/82ec9293-050f-48f2-b0fd-e563145c6cb3" status: 200 len: 1521 microversion: 2.1 time: 0.195809 Jul 05 20:55:58.446200 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 97/205] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:55:58 2022] GET /compute/v2.1/servers/82ec9293-050f-48f2-b0fd-e563145c6cb3 => generated 1521 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 20:55:59.463338 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-0c64cd07-3817-46f7-9372-84b9239834e8 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:55:59.464554 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-0c64cd07-3817-46f7-9372-84b9239834e8 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] [instance: 82ec9293-050f-48f2-b0fd-e563145c6cb3] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:55:59.471639 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-0c64cd07-3817-46f7-9372-84b9239834e8 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:55:59.472280 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-0c64cd07-3817-46f7-9372-84b9239834e8 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:55:59.473070 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-0c64cd07-3817-46f7-9372-84b9239834e8 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:55:59.473683 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-0c64cd07-3817-46f7-9372-84b9239834e8 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:55:59.620125 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-0c64cd07-3817-46f7-9372-84b9239834e8 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd152763a64794301b21587ab2b395bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc6d47f96d17471d94367bc8f8a3e3f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:55:59.628358 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-0c64cd07-3817-46f7-9372-84b9239834e8 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] 10.222.0.20 "GET /compute/v2.1/servers/82ec9293-050f-48f2-b0fd-e563145c6cb3" status: 200 len: 1501 microversion: 2.1 time: 0.168871 Jul 05 20:55:59.629187 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 109/206] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:55:59 2022] GET /compute/v2.1/servers/82ec9293-050f-48f2-b0fd-e563145c6cb3 => generated 1501 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 20:55:59.646899 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-fb75059f-60e1-467c-8733-44fc7e3c8e8e tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:55:59.647529 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-fb75059f-60e1-467c-8733-44fc7e3c8e8e tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] [instance: a3aeae5c-d73d-4fb3-afa0-ee691e6a4fd4] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:55:59.657022 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-fb75059f-60e1-467c-8733-44fc7e3c8e8e tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:55:59.657443 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-fb75059f-60e1-467c-8733-44fc7e3c8e8e tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:55:59.658407 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-fb75059f-60e1-467c-8733-44fc7e3c8e8e tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:55:59.658830 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-fb75059f-60e1-467c-8733-44fc7e3c8e8e tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:55:59.851949 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-fb75059f-60e1-467c-8733-44fc7e3c8e8e tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd152763a64794301b21587ab2b395bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc6d47f96d17471d94367bc8f8a3e3f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:55:59.860105 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-fb75059f-60e1-467c-8733-44fc7e3c8e8e tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] 10.222.0.20 "GET /compute/v2.1/servers/a3aeae5c-d73d-4fb3-afa0-ee691e6a4fd4" status: 200 len: 1517 microversion: 2.1 time: 0.218800 Jul 05 20:55:59.865039 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 98/207] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:55:59 2022] GET /compute/v2.1/servers/a3aeae5c-d73d-4fb3-afa0-ee691e6a4fd4 => generated 1517 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 20:56:03.395134 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-b4dba702-05dc-4364-8a71-0a5a4f4e8736 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 20:56:03.396047 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-b4dba702-05dc-4364-8a71-0a5a4f4e8736 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] [instance: a3aeae5c-d73d-4fb3-afa0-ee691e6a4fd4] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:56:03.397958 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG dbcounter [-] [117628] Writing DB stats nova_cell0:SELECT=4 {{(pid=117628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:56:03.403538 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-b4dba702-05dc-4364-8a71-0a5a4f4e8736 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:56:03.403980 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-b4dba702-05dc-4364-8a71-0a5a4f4e8736 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:56:03.404733 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-b4dba702-05dc-4364-8a71-0a5a4f4e8736 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:56:03.405190 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-b4dba702-05dc-4364-8a71-0a5a4f4e8736 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:56:03.428524 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.objects.instance [None req-b4dba702-05dc-4364-8a71-0a5a4f4e8736 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lazy-loading 'flavor' on Instance uuid a3aeae5c-d73d-4fb3-afa0-ee691e6a4fd4 {{(pid=117628) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 05 20:56:03.503136 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-b4dba702-05dc-4364-8a71-0a5a4f4e8736 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] 10.222.0.20 "POST /compute/v2.1/servers/a3aeae5c-d73d-4fb3-afa0-ee691e6a4fd4/action" status: 200 len: 32 microversion: 2.1 time: 0.112393 Jul 05 20:56:03.503770 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 110/208] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Jul 5 20:56:03 2022] POST /compute/v2.1/servers/a3aeae5c-d73d-4fb3-afa0-ee691e6a4fd4/action => generated 32 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 05 20:56:03.520003 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-51434d48-581e-492e-a33a-5458c6885a1b tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:56:03.522049 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-51434d48-581e-492e-a33a-5458c6885a1b tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] [instance: a3aeae5c-d73d-4fb3-afa0-ee691e6a4fd4] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:56:03.530308 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-51434d48-581e-492e-a33a-5458c6885a1b tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:56:03.531650 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-51434d48-581e-492e-a33a-5458c6885a1b tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:56:03.533058 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-51434d48-581e-492e-a33a-5458c6885a1b tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:56:03.533513 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-51434d48-581e-492e-a33a-5458c6885a1b tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:56:04.048702 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-51434d48-581e-492e-a33a-5458c6885a1b tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd152763a64794301b21587ab2b395bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc6d47f96d17471d94367bc8f8a3e3f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:56:04.058071 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-51434d48-581e-492e-a33a-5458c6885a1b tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] 10.222.0.20 "GET /compute/v2.1/servers/a3aeae5c-d73d-4fb3-afa0-ee691e6a4fd4" status: 200 len: 1523 microversion: 2.1 time: 0.546113 Jul 05 20:56:04.059034 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 99/209] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:56:03 2022] GET /compute/v2.1/servers/a3aeae5c-d73d-4fb3-afa0-ee691e6a4fd4 => generated 1523 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 20:56:05.078764 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-3eac1d8f-e352-4362-9d4b-6c240f8f07d8 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:56:05.079552 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-3eac1d8f-e352-4362-9d4b-6c240f8f07d8 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] [instance: a3aeae5c-d73d-4fb3-afa0-ee691e6a4fd4] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:56:05.086711 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-3eac1d8f-e352-4362-9d4b-6c240f8f07d8 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:56:05.087707 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-3eac1d8f-e352-4362-9d4b-6c240f8f07d8 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:56:05.088695 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-3eac1d8f-e352-4362-9d4b-6c240f8f07d8 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:56:05.090535 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-3eac1d8f-e352-4362-9d4b-6c240f8f07d8 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:56:05.248959 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-3eac1d8f-e352-4362-9d4b-6c240f8f07d8 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd152763a64794301b21587ab2b395bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc6d47f96d17471d94367bc8f8a3e3f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:56:05.258838 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-3eac1d8f-e352-4362-9d4b-6c240f8f07d8 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] 10.222.0.20 "GET /compute/v2.1/servers/a3aeae5c-d73d-4fb3-afa0-ee691e6a4fd4" status: 200 len: 1523 microversion: 2.1 time: 0.185949 Jul 05 20:56:05.259633 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 111/210] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:56:05 2022] GET /compute/v2.1/servers/a3aeae5c-d73d-4fb3-afa0-ee691e6a4fd4 => generated 1523 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 20:56:06.277924 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-4c65865c-39fa-4743-993f-10f5afae6401 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:56:06.278882 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-4c65865c-39fa-4743-993f-10f5afae6401 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] [instance: a3aeae5c-d73d-4fb3-afa0-ee691e6a4fd4] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:56:06.288807 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-4c65865c-39fa-4743-993f-10f5afae6401 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:56:06.289753 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-4c65865c-39fa-4743-993f-10f5afae6401 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:56:06.290772 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-4c65865c-39fa-4743-993f-10f5afae6401 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:56:06.291568 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-4c65865c-39fa-4743-993f-10f5afae6401 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:56:06.463700 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-4c65865c-39fa-4743-993f-10f5afae6401 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd152763a64794301b21587ab2b395bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc6d47f96d17471d94367bc8f8a3e3f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:56:06.474869 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-4c65865c-39fa-4743-993f-10f5afae6401 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] 10.222.0.20 "GET /compute/v2.1/servers/a3aeae5c-d73d-4fb3-afa0-ee691e6a4fd4" status: 200 len: 1523 microversion: 2.1 time: 0.201635 Jul 05 20:56:06.475927 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 100/211] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:56:06 2022] GET /compute/v2.1/servers/a3aeae5c-d73d-4fb3-afa0-ee691e6a4fd4 => generated 1523 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 20:56:07.494397 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-bb2eb415-fc92-4b4a-80a8-260338ffae4e tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:56:07.494934 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-bb2eb415-fc92-4b4a-80a8-260338ffae4e tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] [instance: a3aeae5c-d73d-4fb3-afa0-ee691e6a4fd4] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:56:07.501733 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-bb2eb415-fc92-4b4a-80a8-260338ffae4e tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:56:07.502175 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-bb2eb415-fc92-4b4a-80a8-260338ffae4e tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:56:07.502933 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-bb2eb415-fc92-4b4a-80a8-260338ffae4e tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:56:07.503362 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-bb2eb415-fc92-4b4a-80a8-260338ffae4e tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:56:07.631629 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-bb2eb415-fc92-4b4a-80a8-260338ffae4e tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd152763a64794301b21587ab2b395bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc6d47f96d17471d94367bc8f8a3e3f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:56:07.639494 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-bb2eb415-fc92-4b4a-80a8-260338ffae4e tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] 10.222.0.20 "GET /compute/v2.1/servers/a3aeae5c-d73d-4fb3-afa0-ee691e6a4fd4" status: 200 len: 1523 microversion: 2.1 time: 0.149830 Jul 05 20:56:07.640123 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 112/212] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:56:07 2022] GET /compute/v2.1/servers/a3aeae5c-d73d-4fb3-afa0-ee691e6a4fd4 => generated 1523 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 20:56:08.656905 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-2cdf7bc3-5041-40c2-b6da-a6aa896ad7b1 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:56:08.657538 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-2cdf7bc3-5041-40c2-b6da-a6aa896ad7b1 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] [instance: a3aeae5c-d73d-4fb3-afa0-ee691e6a4fd4] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:56:08.663913 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-2cdf7bc3-5041-40c2-b6da-a6aa896ad7b1 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:56:08.664360 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-2cdf7bc3-5041-40c2-b6da-a6aa896ad7b1 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:56:08.665176 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-2cdf7bc3-5041-40c2-b6da-a6aa896ad7b1 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:56:08.665643 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-2cdf7bc3-5041-40c2-b6da-a6aa896ad7b1 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:56:08.669649 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG dbcounter [-] [117627] Writing DB stats nova_cell1:SELECT=74 {{(pid=117627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:56:08.803451 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-2cdf7bc3-5041-40c2-b6da-a6aa896ad7b1 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd152763a64794301b21587ab2b395bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc6d47f96d17471d94367bc8f8a3e3f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:56:08.811173 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-2cdf7bc3-5041-40c2-b6da-a6aa896ad7b1 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] 10.222.0.20 "GET /compute/v2.1/servers/a3aeae5c-d73d-4fb3-afa0-ee691e6a4fd4" status: 200 len: 1523 microversion: 2.1 time: 0.158122 Jul 05 20:56:08.811743 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 101/213] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:56:08 2022] GET /compute/v2.1/servers/a3aeae5c-d73d-4fb3-afa0-ee691e6a4fd4 => generated 1523 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 20:56:09.831890 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-7bb1c3b4-f42b-41e3-a3af-6eb35ada590a tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:56:09.833333 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-7bb1c3b4-f42b-41e3-a3af-6eb35ada590a tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] [instance: a3aeae5c-d73d-4fb3-afa0-ee691e6a4fd4] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:56:09.842100 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-7bb1c3b4-f42b-41e3-a3af-6eb35ada590a tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:56:09.842791 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-7bb1c3b4-f42b-41e3-a3af-6eb35ada590a tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:56:09.844480 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-7bb1c3b4-f42b-41e3-a3af-6eb35ada590a tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:56:09.845747 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-7bb1c3b4-f42b-41e3-a3af-6eb35ada590a tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:56:10.031595 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-7bb1c3b4-f42b-41e3-a3af-6eb35ada590a tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd152763a64794301b21587ab2b395bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc6d47f96d17471d94367bc8f8a3e3f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:56:10.040049 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-7bb1c3b4-f42b-41e3-a3af-6eb35ada590a tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] 10.222.0.20 "GET /compute/v2.1/servers/a3aeae5c-d73d-4fb3-afa0-ee691e6a4fd4" status: 200 len: 1523 microversion: 2.1 time: 0.214758 Jul 05 20:56:10.040625 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 113/214] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:56:09 2022] GET /compute/v2.1/servers/a3aeae5c-d73d-4fb3-afa0-ee691e6a4fd4 => generated 1523 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 20:56:11.056551 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-708d1802-cc21-4f62-9e6c-eecc5667785e tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:56:11.057076 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-708d1802-cc21-4f62-9e6c-eecc5667785e tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] [instance: a3aeae5c-d73d-4fb3-afa0-ee691e6a4fd4] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:56:11.064725 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-708d1802-cc21-4f62-9e6c-eecc5667785e tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:56:11.065308 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-708d1802-cc21-4f62-9e6c-eecc5667785e tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:56:11.066467 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-708d1802-cc21-4f62-9e6c-eecc5667785e tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:56:11.066964 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-708d1802-cc21-4f62-9e6c-eecc5667785e tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:56:11.256212 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-708d1802-cc21-4f62-9e6c-eecc5667785e tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd152763a64794301b21587ab2b395bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc6d47f96d17471d94367bc8f8a3e3f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:56:11.265780 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-708d1802-cc21-4f62-9e6c-eecc5667785e tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] 10.222.0.20 "GET /compute/v2.1/servers/a3aeae5c-d73d-4fb3-afa0-ee691e6a4fd4" status: 200 len: 1523 microversion: 2.1 time: 0.213417 Jul 05 20:56:11.277430 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 102/215] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:56:11 2022] GET /compute/v2.1/servers/a3aeae5c-d73d-4fb3-afa0-ee691e6a4fd4 => generated 1523 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 20:56:12.284396 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-b58b58f3-7229-4b57-b315-129f2c675a04 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:56:12.285021 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-b58b58f3-7229-4b57-b315-129f2c675a04 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] [instance: a3aeae5c-d73d-4fb3-afa0-ee691e6a4fd4] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:56:12.290901 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-b58b58f3-7229-4b57-b315-129f2c675a04 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:56:12.291341 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-b58b58f3-7229-4b57-b315-129f2c675a04 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:56:12.292093 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-b58b58f3-7229-4b57-b315-129f2c675a04 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:56:12.292522 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-b58b58f3-7229-4b57-b315-129f2c675a04 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:56:12.430378 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-b58b58f3-7229-4b57-b315-129f2c675a04 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd152763a64794301b21587ab2b395bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc6d47f96d17471d94367bc8f8a3e3f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:56:12.438439 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-b58b58f3-7229-4b57-b315-129f2c675a04 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] 10.222.0.20 "GET /compute/v2.1/servers/a3aeae5c-d73d-4fb3-afa0-ee691e6a4fd4" status: 200 len: 1523 microversion: 2.1 time: 0.158348 Jul 05 20:56:12.439261 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 114/216] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:56:12 2022] GET /compute/v2.1/servers/a3aeae5c-d73d-4fb3-afa0-ee691e6a4fd4 => generated 1523 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 20:56:13.458550 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-63a8caef-5dac-475b-a889-7283b4b864a6 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:56:13.459777 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-63a8caef-5dac-475b-a889-7283b4b864a6 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] [instance: a3aeae5c-d73d-4fb3-afa0-ee691e6a4fd4] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:56:13.466385 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-63a8caef-5dac-475b-a889-7283b4b864a6 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:56:13.466919 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-63a8caef-5dac-475b-a889-7283b4b864a6 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:56:13.467755 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-63a8caef-5dac-475b-a889-7283b4b864a6 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:56:13.468180 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-63a8caef-5dac-475b-a889-7283b4b864a6 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:56:13.630192 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-63a8caef-5dac-475b-a889-7283b4b864a6 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd152763a64794301b21587ab2b395bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc6d47f96d17471d94367bc8f8a3e3f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:56:13.639229 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-63a8caef-5dac-475b-a889-7283b4b864a6 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] 10.222.0.20 "GET /compute/v2.1/servers/a3aeae5c-d73d-4fb3-afa0-ee691e6a4fd4" status: 200 len: 1523 microversion: 2.1 time: 0.186347 Jul 05 20:56:13.640163 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 103/217] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:56:13 2022] GET /compute/v2.1/servers/a3aeae5c-d73d-4fb3-afa0-ee691e6a4fd4 => generated 1523 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 20:56:14.659343 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-ee3dfb2e-34ae-40a2-9661-d2deb5dfb1eb tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:56:14.661100 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-ee3dfb2e-34ae-40a2-9661-d2deb5dfb1eb tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] [instance: a3aeae5c-d73d-4fb3-afa0-ee691e6a4fd4] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:56:14.668144 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-ee3dfb2e-34ae-40a2-9661-d2deb5dfb1eb tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:56:14.668599 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-ee3dfb2e-34ae-40a2-9661-d2deb5dfb1eb tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:56:14.669401 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-ee3dfb2e-34ae-40a2-9661-d2deb5dfb1eb tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:56:14.669840 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-ee3dfb2e-34ae-40a2-9661-d2deb5dfb1eb tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:56:14.723468 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-10aa13d2-ba01-4721-bbe5-2e226ef964ea tempest-VolumesActionsTest-1665182479 tempest-VolumesActionsTest-1665182479-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1224534118", "imageRef": "88e08f49-c01d-4849-a89f-b678588e56f4", "flavorRef": "452", "networks": [{"uuid": "2761cbb9-4367-450c-83c6-d327fdcfa178"}]}} {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 20:56:14.732827 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG dbcounter [-] [117627] Writing DB stats nova_api:SELECT=26 {{(pid=117627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:56:14.794061 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.network.neutron [None req-10aa13d2-ba01-4721-bbe5-2e226ef964ea tempest-VolumesActionsTest-1665182479 tempest-VolumesActionsTest-1665182479-project] validate_networks() for [('2761cbb9-4367-450c-83c6-d327fdcfa178', None, None, None, None, None)] {{(pid=117627) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 05 20:56:14.905020 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-ee3dfb2e-34ae-40a2-9661-d2deb5dfb1eb tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd152763a64794301b21587ab2b395bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc6d47f96d17471d94367bc8f8a3e3f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:56:14.913409 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-ee3dfb2e-34ae-40a2-9661-d2deb5dfb1eb tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] 10.222.0.20 "GET /compute/v2.1/servers/a3aeae5c-d73d-4fb3-afa0-ee691e6a4fd4" status: 200 len: 1523 microversion: 2.1 time: 0.259818 Jul 05 20:56:14.913985 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 115/218] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:56:14 2022] GET /compute/v2.1/servers/a3aeae5c-d73d-4fb3-afa0-ee691e6a4fd4 => generated 1523 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 20:56:15.184575 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.virt.hardware [None req-10aa13d2-ba01-4721-bbe5-2e226ef964ea tempest-VolumesActionsTest-1665182479 tempest-VolumesActionsTest-1665182479-project] Flavor limits 0:0:0 {{(pid=117627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 05 20:56:15.185053 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.virt.hardware [None req-10aa13d2-ba01-4721-bbe5-2e226ef964ea tempest-VolumesActionsTest-1665182479 tempest-VolumesActionsTest-1665182479-project] Image limits 0:0:0 {{(pid=117627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 05 20:56:15.185523 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.virt.hardware [None req-10aa13d2-ba01-4721-bbe5-2e226ef964ea tempest-VolumesActionsTest-1665182479 tempest-VolumesActionsTest-1665182479-project] Flavor pref 0:0:0 {{(pid=117627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 05 20:56:15.185927 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.virt.hardware [None req-10aa13d2-ba01-4721-bbe5-2e226ef964ea tempest-VolumesActionsTest-1665182479 tempest-VolumesActionsTest-1665182479-project] Image pref 0:0:0 {{(pid=117627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 05 20:56:15.186348 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.virt.hardware [None req-10aa13d2-ba01-4721-bbe5-2e226ef964ea tempest-VolumesActionsTest-1665182479 tempest-VolumesActionsTest-1665182479-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 05 20:56:15.195385 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-10aa13d2-ba01-4721-bbe5-2e226ef964ea tempest-VolumesActionsTest-1665182479 tempest-VolumesActionsTest-1665182479-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:56:15.195830 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-10aa13d2-ba01-4721-bbe5-2e226ef964ea tempest-VolumesActionsTest-1665182479 tempest-VolumesActionsTest-1665182479-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:56:15.196616 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-10aa13d2-ba01-4721-bbe5-2e226ef964ea tempest-VolumesActionsTest-1665182479 tempest-VolumesActionsTest-1665182479-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:56:15.197090 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-10aa13d2-ba01-4721-bbe5-2e226ef964ea tempest-VolumesActionsTest-1665182479 tempest-VolumesActionsTest-1665182479-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:56:15.214202 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.quota [None req-10aa13d2-ba01-4721-bbe5-2e226ef964ea tempest-VolumesActionsTest-1665182479 tempest-VolumesActionsTest-1665182479-project] Getting quotas for project a407f0bf436c4987b9eb2e59c46d82a9. Resources: {'cores', 'ram', 'instances'} {{(pid=117627) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 05 20:56:15.218127 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.quota [None req-10aa13d2-ba01-4721-bbe5-2e226ef964ea tempest-VolumesActionsTest-1665182479 tempest-VolumesActionsTest-1665182479-project] Getting quotas for user fd273630a84d41f49dcf8208c618f256 and project a407f0bf436c4987b9eb2e59c46d82a9. Resources: {'cores', 'ram', 'instances'} {{(pid=117627) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 05 20:56:15.230071 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-10aa13d2-ba01-4721-bbe5-2e226ef964ea tempest-VolumesActionsTest-1665182479 tempest-VolumesActionsTest-1665182479-project] Going to run 1 instances... {{(pid=117627) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 05 20:56:15.232284 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-10aa13d2-ba01-4721-bbe5-2e226ef964ea tempest-VolumesActionsTest-1665182479 tempest-VolumesActionsTest-1665182479-project] [instance: 41985a43-8b24-478a-8b18-c8559af076c9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='88e08f49-c01d-4849-a89f-b678588e56f4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117627) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 05 20:56:15.278120 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-10aa13d2-ba01-4721-bbe5-2e226ef964ea tempest-VolumesActionsTest-1665182479 tempest-VolumesActionsTest-1665182479-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.561764 Jul 05 20:56:15.279877 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 104/219] 10.222.0.20 () {60 vars in 1146 bytes} [Tue Jul 5 20:56:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 564 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 05 20:56:15.291724 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-254b1d50-9f39-4d76-b6c2-7c040b4ca327 tempest-VolumesActionsTest-1665182479 tempest-VolumesActionsTest-1665182479-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:56:15.292329 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-254b1d50-9f39-4d76-b6c2-7c040b4ca327 tempest-VolumesActionsTest-1665182479 tempest-VolumesActionsTest-1665182479-project] [instance: 41985a43-8b24-478a-8b18-c8559af076c9] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:56:15.347112 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-254b1d50-9f39-4d76-b6c2-7c040b4ca327 tempest-VolumesActionsTest-1665182479 tempest-VolumesActionsTest-1665182479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd273630a84d41f49dcf8208c618f256', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a407f0bf436c4987b9eb2e59c46d82a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:56:15.354305 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-254b1d50-9f39-4d76-b6c2-7c040b4ca327 tempest-VolumesActionsTest-1665182479 tempest-VolumesActionsTest-1665182479-project] 10.222.0.20 "GET /compute/v2.1/servers/41985a43-8b24-478a-8b18-c8559af076c9" status: 200 len: 1214 microversion: 2.1 time: 0.066376 Jul 05 20:56:15.354884 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 116/220] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:56:15 2022] GET /compute/v2.1/servers/41985a43-8b24-478a-8b18-c8559af076c9 => generated 1214 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 20:56:15.931907 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-9813ec1a-194d-4144-8e2a-4a03ecbfce70 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:56:15.932515 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-9813ec1a-194d-4144-8e2a-4a03ecbfce70 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] [instance: a3aeae5c-d73d-4fb3-afa0-ee691e6a4fd4] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:56:15.945558 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-9813ec1a-194d-4144-8e2a-4a03ecbfce70 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:56:15.946313 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-9813ec1a-194d-4144-8e2a-4a03ecbfce70 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:56:15.947311 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-9813ec1a-194d-4144-8e2a-4a03ecbfce70 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:56:15.947983 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-9813ec1a-194d-4144-8e2a-4a03ecbfce70 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:56:16.084067 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-9813ec1a-194d-4144-8e2a-4a03ecbfce70 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd152763a64794301b21587ab2b395bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc6d47f96d17471d94367bc8f8a3e3f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:56:16.091650 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-9813ec1a-194d-4144-8e2a-4a03ecbfce70 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] 10.222.0.20 "GET /compute/v2.1/servers/a3aeae5c-d73d-4fb3-afa0-ee691e6a4fd4" status: 200 len: 1523 microversion: 2.1 time: 0.163621 Jul 05 20:56:16.092210 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 105/221] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:56:15 2022] GET /compute/v2.1/servers/a3aeae5c-d73d-4fb3-afa0-ee691e6a4fd4 => generated 1523 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 20:56:16.371898 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-f81ce3b6-b830-4d87-b529-91e6a014a819 tempest-VolumesActionsTest-1665182479 tempest-VolumesActionsTest-1665182479-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:56:16.372623 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-f81ce3b6-b830-4d87-b529-91e6a014a819 tempest-VolumesActionsTest-1665182479 tempest-VolumesActionsTest-1665182479-project] [instance: 41985a43-8b24-478a-8b18-c8559af076c9] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:56:16.379549 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-f81ce3b6-b830-4d87-b529-91e6a014a819 tempest-VolumesActionsTest-1665182479 tempest-VolumesActionsTest-1665182479-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:56:16.380210 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-f81ce3b6-b830-4d87-b529-91e6a014a819 tempest-VolumesActionsTest-1665182479 tempest-VolumesActionsTest-1665182479-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:56:16.381002 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-f81ce3b6-b830-4d87-b529-91e6a014a819 tempest-VolumesActionsTest-1665182479 tempest-VolumesActionsTest-1665182479-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:56:16.381441 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-f81ce3b6-b830-4d87-b529-91e6a014a819 tempest-VolumesActionsTest-1665182479 tempest-VolumesActionsTest-1665182479-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:56:16.398822 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG dbcounter [-] [117628] Writing DB stats nova_cell1:SELECT=80,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:56:16.459843 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-f81ce3b6-b830-4d87-b529-91e6a014a819 tempest-VolumesActionsTest-1665182479 tempest-VolumesActionsTest-1665182479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd273630a84d41f49dcf8208c618f256', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a407f0bf436c4987b9eb2e59c46d82a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:56:16.467471 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-f81ce3b6-b830-4d87-b529-91e6a014a819 tempest-VolumesActionsTest-1665182479 tempest-VolumesActionsTest-1665182479-project] 10.222.0.20 "GET /compute/v2.1/servers/41985a43-8b24-478a-8b18-c8559af076c9" status: 200 len: 1210 microversion: 2.1 time: 0.099656 Jul 05 20:56:16.468033 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 117/222] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:56:16 2022] GET /compute/v2.1/servers/41985a43-8b24-478a-8b18-c8559af076c9 => generated 1210 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 20:56:17.108775 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-fbda4b38-ee18-41ae-9bb5-fe41b429db33 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:56:17.109443 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-fbda4b38-ee18-41ae-9bb5-fe41b429db33 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] [instance: a3aeae5c-d73d-4fb3-afa0-ee691e6a4fd4] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:56:17.116169 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-fbda4b38-ee18-41ae-9bb5-fe41b429db33 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:56:17.116640 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-fbda4b38-ee18-41ae-9bb5-fe41b429db33 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:56:17.117430 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-fbda4b38-ee18-41ae-9bb5-fe41b429db33 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:56:17.117864 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-fbda4b38-ee18-41ae-9bb5-fe41b429db33 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:56:17.256694 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-fbda4b38-ee18-41ae-9bb5-fe41b429db33 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd152763a64794301b21587ab2b395bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc6d47f96d17471d94367bc8f8a3e3f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:56:17.264811 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-fbda4b38-ee18-41ae-9bb5-fe41b429db33 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] 10.222.0.20 "GET /compute/v2.1/servers/a3aeae5c-d73d-4fb3-afa0-ee691e6a4fd4" status: 200 len: 1523 microversion: 2.1 time: 0.159801 Jul 05 20:56:17.265420 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 106/223] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:56:17 2022] GET /compute/v2.1/servers/a3aeae5c-d73d-4fb3-afa0-ee691e6a4fd4 => generated 1523 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 20:56:17.486540 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-8479d66a-c0e7-47da-87c8-4c4111a44a6b tempest-VolumesActionsTest-1665182479 tempest-VolumesActionsTest-1665182479-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:56:17.487528 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-8479d66a-c0e7-47da-87c8-4c4111a44a6b tempest-VolumesActionsTest-1665182479 tempest-VolumesActionsTest-1665182479-project] [instance: 41985a43-8b24-478a-8b18-c8559af076c9] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:56:17.496073 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-8479d66a-c0e7-47da-87c8-4c4111a44a6b tempest-VolumesActionsTest-1665182479 tempest-VolumesActionsTest-1665182479-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:56:17.496601 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-8479d66a-c0e7-47da-87c8-4c4111a44a6b tempest-VolumesActionsTest-1665182479 tempest-VolumesActionsTest-1665182479-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:56:17.497394 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-8479d66a-c0e7-47da-87c8-4c4111a44a6b tempest-VolumesActionsTest-1665182479 tempest-VolumesActionsTest-1665182479-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:56:17.497818 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-8479d66a-c0e7-47da-87c8-4c4111a44a6b tempest-VolumesActionsTest-1665182479 tempest-VolumesActionsTest-1665182479-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:56:17.565256 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-8479d66a-c0e7-47da-87c8-4c4111a44a6b tempest-VolumesActionsTest-1665182479 tempest-VolumesActionsTest-1665182479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd273630a84d41f49dcf8208c618f256', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a407f0bf436c4987b9eb2e59c46d82a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:56:17.572724 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-8479d66a-c0e7-47da-87c8-4c4111a44a6b tempest-VolumesActionsTest-1665182479 tempest-VolumesActionsTest-1665182479-project] 10.222.0.20 "GET /compute/v2.1/servers/41985a43-8b24-478a-8b18-c8559af076c9" status: 200 len: 1274 microversion: 2.1 time: 0.091322 Jul 05 20:56:17.573310 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 118/224] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:56:17 2022] GET /compute/v2.1/servers/41985a43-8b24-478a-8b18-c8559af076c9 => generated 1274 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 20:56:18.012414 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-42390645-188b-4214-a345-17ddf8fc0937 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:56:18.012822 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-42390645-188b-4214-a345-17ddf8fc0937 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] [instance: f236112c-4649-478b-a626-b84f8ff1bfe9] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:56:18.019934 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-42390645-188b-4214-a345-17ddf8fc0937 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:56:18.020411 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-42390645-188b-4214-a345-17ddf8fc0937 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:56:18.021207 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-42390645-188b-4214-a345-17ddf8fc0937 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:56:18.021638 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-42390645-188b-4214-a345-17ddf8fc0937 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:56:18.045138 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-42390645-188b-4214-a345-17ddf8fc0937 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] 10.222.0.20 "GET /compute/v2.1/servers/f236112c-4649-478b-a626-b84f8ff1bfe9/ips" status: 200 len: 144 microversion: 2.1 time: 0.036623 Jul 05 20:56:18.045645 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 107/225] 10.222.0.20 () {58 vars in 1247 bytes} [Tue Jul 5 20:56:18 2022] GET /compute/v2.1/servers/f236112c-4649-478b-a626-b84f8ff1bfe9/ips => generated 144 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 20:56:18.285408 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-1fdf8685-0ca5-4cc6-8d94-5375ba0aba86 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:56:18.286015 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-1fdf8685-0ca5-4cc6-8d94-5375ba0aba86 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] [instance: a3aeae5c-d73d-4fb3-afa0-ee691e6a4fd4] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:56:18.292346 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-1fdf8685-0ca5-4cc6-8d94-5375ba0aba86 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:56:18.292856 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-1fdf8685-0ca5-4cc6-8d94-5375ba0aba86 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:56:18.293802 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-1fdf8685-0ca5-4cc6-8d94-5375ba0aba86 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:56:18.294237 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-1fdf8685-0ca5-4cc6-8d94-5375ba0aba86 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:56:18.428458 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-1fdf8685-0ca5-4cc6-8d94-5375ba0aba86 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd152763a64794301b21587ab2b395bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc6d47f96d17471d94367bc8f8a3e3f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:56:18.436030 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-1fdf8685-0ca5-4cc6-8d94-5375ba0aba86 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] 10.222.0.20 "GET /compute/v2.1/servers/a3aeae5c-d73d-4fb3-afa0-ee691e6a4fd4" status: 200 len: 1503 microversion: 2.1 time: 0.155103 Jul 05 20:56:18.436700 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 119/226] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:56:18 2022] GET /compute/v2.1/servers/a3aeae5c-d73d-4fb3-afa0-ee691e6a4fd4 => generated 1503 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 20:56:18.453125 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-6c13ea79-2d4e-4605-a695-b98df1bfa2e6 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2224a541-bc40-4b85-a87f-019663960682"}} {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 20:56:18.455222 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-6c13ea79-2d4e-4605-a695-b98df1bfa2e6 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] [instance: a3aeae5c-d73d-4fb3-afa0-ee691e6a4fd4] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:56:18.461907 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-6c13ea79-2d4e-4605-a695-b98df1bfa2e6 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:56:18.462349 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-6c13ea79-2d4e-4605-a695-b98df1bfa2e6 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:56:18.463100 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-6c13ea79-2d4e-4605-a695-b98df1bfa2e6 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:56:18.463526 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-6c13ea79-2d4e-4605-a695-b98df1bfa2e6 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:56:18.486457 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.wsgi [None req-6c13ea79-2d4e-4605-a695-b98df1bfa2e6 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] HTTP exception thrown: Cannot 'attach_volume' instance a3aeae5c-d73d-4fb3-afa0-ee691e6a4fd4 while it is in vm_state rescued Jul 05 20:56:18.488157 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-6c13ea79-2d4e-4605-a695-b98df1bfa2e6 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Request method failure captured: Jul 05 20:56:18.488157 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: request: POST /compute/v2.1/servers/a3aeae5c-d73d-4fb3-afa0-ee691e6a4fd4/os-volume_attachments HTTP/1.1 Jul 05 20:56:18.488157 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: Accept: application/json Jul 05 20:56:18.488157 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: Accept-Encoding: identity Jul 05 20:56:18.488157 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: Connection: close Jul 05 20:56:18.488157 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: Content-Length: 74 Jul 05 20:56:18.488157 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: Content-Type: application/json Jul 05 20:56:18.488157 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: Host: 10.222.0.20 Jul 05 20:56:18.488157 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: Openstack-System-Scope: None Jul 05 20:56:18.488157 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: User-Agent: python-urllib3/1.26.9 Jul 05 20:56:18.488157 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Auth-Token: gAAAAABixKUPNuH34QdH2KDVfn6Xq2ExRJFV_gfDikdto6Gtv-4vxOCZQ-cLxCvkxKeLcktJgVnSU2DRVovOt1N1tNauQsWgnI_IcnWeNaI2cc_3sRiAXqXL8oS987NWbN-5be6gxd3B2gK8PLp16_Qnn5ivzsTuuUNEU8MMiW1aGUc2_5VIMUQ Jul 05 20:56:18.488157 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Domain-Id: None Jul 05 20:56:18.488157 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Domain-Name: None Jul 05 20:56:18.488157 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Identity-Status: Confirmed Jul 05 20:56:18.488157 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Is-Admin-Project: True Jul 05 20:56:18.488157 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Project-Domain-Id: default Jul 05 20:56:18.488157 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Project-Domain-Name: Default Jul 05 20:56:18.488157 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Project-Id: fc6d47f96d17471d94367bc8f8a3e3f6 Jul 05 20:56:18.488157 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1951132500 Jul 05 20:56:18.488157 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Role: member,reader Jul 05 20:56:18.488157 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Roles: member,reader Jul 05 20:56:18.490404 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/fc6d47f96d17471d94367bc8f8a3e3f6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/fc6d47f96d17471d94367bc8f8a3e3f6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_fc6d47f96d17471d94367bc8f8a3e3f6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/fc6d47f96d17471d94367bc8f8a3e3f6"}]}] Jul 05 20:56:18.490404 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1951132500 Jul 05 20:56:18.490404 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Tenant-Id: fc6d47f96d17471d94367bc8f8a3e3f6 Jul 05 20:56:18.490404 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1951132500 Jul 05 20:56:18.490404 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-User: tempest-ServerRescueNegativeTestJSON-1951132500-project Jul 05 20:56:18.490404 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-User-Domain-Id: default Jul 05 20:56:18.490404 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-User-Domain-Name: Default Jul 05 20:56:18.490404 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-User-Id: d152763a64794301b21587ab2b395bbf Jul 05 20:56:18.490404 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1951132500-project Jul 05 20:56:18.490404 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: Jul 05 20:56:18.490404 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: {"volumeAttachment": {"volumeId": "2224a541-bc40-4b85-a87f-019663960682"}} Jul 05 20:56:18.490404 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: method: > Jul 05 20:56:18.491747 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: exception: Cannot 'attach_volume' instance a3aeae5c-d73d-4fb3-afa0-ee691e6a4fd4 while it is in vm_state rescued Jul 05 20:56:18.491747 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: action_args: {'server_id': 'a3aeae5c-d73d-4fb3-afa0-ee691e6a4fd4', 'body': {'volumeAttachment': {'volumeId': '2224a541-bc40-4b85-a87f-019663960682'}}} Jul 05 20:56:18.491747 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 05 20:56:18.491747 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 20:56:18.491747 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 05 20:56:18.491747 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 05 20:56:18.491747 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 05 20:56:18.491747 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 05 20:56:18.491747 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 05 20:56:18.491747 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 05 20:56:18.491747 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance a3aeae5c-d73d-4fb3-afa0-ee691e6a4fd4 in vm_state rescued. Cannot attach_volume while the instance is in this state. Jul 05 20:56:18.491747 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi Jul 05 20:56:18.491747 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 20:56:18.491747 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi Jul 05 20:56:18.491747 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 20:56:18.491747 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 20:56:18.491747 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 20:56:18.491747 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 05 20:56:18.491747 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 05 20:56:18.494020 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 05 20:56:18.494020 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 05 20:56:18.494020 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 05 20:56:18.494020 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 05 20:56:18.494020 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 05 20:56:18.494020 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 05 20:56:18.494020 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 05 20:56:18.494020 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 05 20:56:18.494020 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jul 05 20:56:18.494020 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 05 20:56:18.494020 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 05 20:56:18.494020 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 05 20:56:18.494020 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance a3aeae5c-d73d-4fb3-afa0-ee691e6a4fd4 while it is in vm_state rescued Jul 05 20:56:18.494020 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi Jul 05 20:56:18.494020 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 20:56:18.494020 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi Jul 05 20:56:18.494020 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 20:56:18.494020 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 20:56:18.494020 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 20:56:18.495953 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 05 20:56:18.495953 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 05 20:56:18.495953 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance a3aeae5c-d73d-4fb3-afa0-ee691e6a4fd4 while it is in vm_state rescued Jul 05 20:56:18.495953 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi Jul 05 20:56:18.495953 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-6c13ea79-2d4e-4605-a695-b98df1bfa2e6 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Returning 409 to user: Cannot 'attach_volume' instance a3aeae5c-d73d-4fb3-afa0-ee691e6a4fd4 while it is in vm_state rescued {{(pid=117627) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 05 20:56:18.495953 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-6c13ea79-2d4e-4605-a695-b98df1bfa2e6 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] 10.222.0.20 "POST /compute/v2.1/servers/a3aeae5c-d73d-4fb3-afa0-ee691e6a4fd4/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.040300 Jul 05 20:56:18.495953 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 108/227] 10.222.0.20 () {60 vars in 1322 bytes} [Tue Jul 5 20:56:18 2022] POST /compute/v2.1/servers/a3aeae5c-d73d-4fb3-afa0-ee691e6a4fd4/os-volume_attachments => generated 152 bytes in 42 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 05 20:56:18.499653 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-e1d400b7-5802-4f9f-8e1c-9e2d45a802db tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 20:56:18.500786 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-e1d400b7-5802-4f9f-8e1c-9e2d45a802db tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] [instance: a3aeae5c-d73d-4fb3-afa0-ee691e6a4fd4] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:56:18.507152 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-e1d400b7-5802-4f9f-8e1c-9e2d45a802db tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:56:18.507726 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-e1d400b7-5802-4f9f-8e1c-9e2d45a802db tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:56:18.508474 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-e1d400b7-5802-4f9f-8e1c-9e2d45a802db tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:56:18.508846 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-e1d400b7-5802-4f9f-8e1c-9e2d45a802db tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:56:18.589963 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-b190b9ee-ce06-4cc9-8300-4568f43fc772 tempest-VolumesActionsTest-1665182479 tempest-VolumesActionsTest-1665182479-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:56:18.590720 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-b190b9ee-ce06-4cc9-8300-4568f43fc772 tempest-VolumesActionsTest-1665182479 tempest-VolumesActionsTest-1665182479-project] [instance: 41985a43-8b24-478a-8b18-c8559af076c9] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:56:18.597274 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-b190b9ee-ce06-4cc9-8300-4568f43fc772 tempest-VolumesActionsTest-1665182479 tempest-VolumesActionsTest-1665182479-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:56:18.598146 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-b190b9ee-ce06-4cc9-8300-4568f43fc772 tempest-VolumesActionsTest-1665182479 tempest-VolumesActionsTest-1665182479-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:56:18.599110 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-b190b9ee-ce06-4cc9-8300-4568f43fc772 tempest-VolumesActionsTest-1665182479 tempest-VolumesActionsTest-1665182479-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:56:18.599766 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-b190b9ee-ce06-4cc9-8300-4568f43fc772 tempest-VolumesActionsTest-1665182479 tempest-VolumesActionsTest-1665182479-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:56:18.632289 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-e1d400b7-5802-4f9f-8e1c-9e2d45a802db tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] 10.222.0.20 "POST /compute/v2.1/servers/a3aeae5c-d73d-4fb3-afa0-ee691e6a4fd4/action" status: 202 len: 0 microversion: 2.1 time: 0.137004 Jul 05 20:56:18.633257 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 120/228] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Jul 5 20:56:18 2022] POST /compute/v2.1/servers/a3aeae5c-d73d-4fb3-afa0-ee691e6a4fd4/action => generated 0 bytes in 139 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 05 20:56:18.642120 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-5488fc7b-cf08-45f5-9b3e-558fe06a9138 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:56:18.643199 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-5488fc7b-cf08-45f5-9b3e-558fe06a9138 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] [instance: a3aeae5c-d73d-4fb3-afa0-ee691e6a4fd4] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:56:18.650934 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-5488fc7b-cf08-45f5-9b3e-558fe06a9138 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:56:18.651398 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-5488fc7b-cf08-45f5-9b3e-558fe06a9138 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:56:18.652231 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-5488fc7b-cf08-45f5-9b3e-558fe06a9138 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:56:18.652673 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-5488fc7b-cf08-45f5-9b3e-558fe06a9138 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:56:18.691921 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-b190b9ee-ce06-4cc9-8300-4568f43fc772 tempest-VolumesActionsTest-1665182479 tempest-VolumesActionsTest-1665182479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd273630a84d41f49dcf8208c618f256', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a407f0bf436c4987b9eb2e59c46d82a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:56:18.700012 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-b190b9ee-ce06-4cc9-8300-4568f43fc772 tempest-VolumesActionsTest-1665182479 tempest-VolumesActionsTest-1665182479-project] 10.222.0.20 "GET /compute/v2.1/servers/41985a43-8b24-478a-8b18-c8559af076c9" status: 200 len: 1272 microversion: 2.1 time: 0.113718 Jul 05 20:56:18.701081 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 109/229] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:56:18 2022] GET /compute/v2.1/servers/41985a43-8b24-478a-8b18-c8559af076c9 => generated 1272 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 20:56:18.935831 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-5488fc7b-cf08-45f5-9b3e-558fe06a9138 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd152763a64794301b21587ab2b395bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc6d47f96d17471d94367bc8f8a3e3f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:56:18.935831 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-5488fc7b-cf08-45f5-9b3e-558fe06a9138 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] 10.222.0.20 "GET /compute/v2.1/servers/a3aeae5c-d73d-4fb3-afa0-ee691e6a4fd4" status: 200 len: 1511 microversion: 2.1 time: 0.297493 Jul 05 20:56:18.941071 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 121/230] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:56:18 2022] GET /compute/v2.1/servers/a3aeae5c-d73d-4fb3-afa0-ee691e6a4fd4 => generated 1511 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 20:56:19.719590 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-75186949-ef70-4511-a0d6-af4f00d90604 tempest-VolumesActionsTest-1665182479 tempest-VolumesActionsTest-1665182479-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:56:19.721839 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-75186949-ef70-4511-a0d6-af4f00d90604 tempest-VolumesActionsTest-1665182479 tempest-VolumesActionsTest-1665182479-project] [instance: 41985a43-8b24-478a-8b18-c8559af076c9] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:56:19.729376 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-75186949-ef70-4511-a0d6-af4f00d90604 tempest-VolumesActionsTest-1665182479 tempest-VolumesActionsTest-1665182479-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:56:19.729816 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-75186949-ef70-4511-a0d6-af4f00d90604 tempest-VolumesActionsTest-1665182479 tempest-VolumesActionsTest-1665182479-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:56:19.730574 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-75186949-ef70-4511-a0d6-af4f00d90604 tempest-VolumesActionsTest-1665182479 tempest-VolumesActionsTest-1665182479-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:56:19.730999 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-75186949-ef70-4511-a0d6-af4f00d90604 tempest-VolumesActionsTest-1665182479 tempest-VolumesActionsTest-1665182479-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:56:19.932645 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-75186949-ef70-4511-a0d6-af4f00d90604 tempest-VolumesActionsTest-1665182479 tempest-VolumesActionsTest-1665182479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd273630a84d41f49dcf8208c618f256', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a407f0bf436c4987b9eb2e59c46d82a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:56:19.940184 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-75186949-ef70-4511-a0d6-af4f00d90604 tempest-VolumesActionsTest-1665182479 tempest-VolumesActionsTest-1665182479-project] 10.222.0.20 "GET /compute/v2.1/servers/41985a43-8b24-478a-8b18-c8559af076c9" status: 200 len: 1314 microversion: 2.1 time: 0.224644 Jul 05 20:56:19.940749 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 110/231] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:56:19 2022] GET /compute/v2.1/servers/41985a43-8b24-478a-8b18-c8559af076c9 => generated 1314 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 20:56:19.952045 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-b05b6e7b-9157-4630-be3e-67af4ee37cb5 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:56:19.952660 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-b05b6e7b-9157-4630-be3e-67af4ee37cb5 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] [instance: a3aeae5c-d73d-4fb3-afa0-ee691e6a4fd4] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:56:19.958767 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-b05b6e7b-9157-4630-be3e-67af4ee37cb5 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:56:19.959218 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-b05b6e7b-9157-4630-be3e-67af4ee37cb5 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:56:19.959981 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-b05b6e7b-9157-4630-be3e-67af4ee37cb5 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:56:19.960417 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-b05b6e7b-9157-4630-be3e-67af4ee37cb5 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:56:20.159821 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-b05b6e7b-9157-4630-be3e-67af4ee37cb5 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd152763a64794301b21587ab2b395bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc6d47f96d17471d94367bc8f8a3e3f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:56:20.168910 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-b05b6e7b-9157-4630-be3e-67af4ee37cb5 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] 10.222.0.20 "GET /compute/v2.1/servers/a3aeae5c-d73d-4fb3-afa0-ee691e6a4fd4" status: 200 len: 1511 microversion: 2.1 time: 0.220696 Jul 05 20:56:20.169884 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 122/232] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:56:19 2022] GET /compute/v2.1/servers/a3aeae5c-d73d-4fb3-afa0-ee691e6a4fd4 => generated 1511 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 20:56:20.551676 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [req-4e61186d-2780-4885-9b9b-b82bd5842833 req-d6fdf569-a2dc-4bd0-a1ca-cffaa0680ba8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "41985a43-8b24-478a-8b18-c8559af076c9", "tag": "776baae1-5f4b-45c1-b0d2-5591f34aba38"}]} {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 20:56:20.560131 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [req-4e61186d-2780-4885-9b9b-b82bd5842833 req-d6fdf569-a2dc-4bd0-a1ca-cffaa0680ba8 service nova] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:56:20.560566 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [req-4e61186d-2780-4885-9b9b-b82bd5842833 req-d6fdf569-a2dc-4bd0-a1ca-cffaa0680ba8 service nova] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:56:20.573032 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.compute.server_external_events [req-4e61186d-2780-4885-9b9b-b82bd5842833 req-d6fdf569-a2dc-4bd0-a1ca-cffaa0680ba8 service nova] Creating event network-changed:776baae1-5f4b-45c1-b0d2-5591f34aba38 for instance 41985a43-8b24-478a-8b18-c8559af076c9 on hv-cinder-79760 Jul 05 20:56:20.577915 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [req-4e61186d-2780-4885-9b9b-b82bd5842833 req-d6fdf569-a2dc-4bd0-a1ca-cffaa0680ba8 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030527 Jul 05 20:56:20.578526 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 111/233] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 5 20:56:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 20:56:20.959023 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-8f102b3d-539b-4855-aa9e-ef9fea758205 tempest-VolumesActionsTest-1665182479 tempest-VolumesActionsTest-1665182479-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:56:20.961165 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-8f102b3d-539b-4855-aa9e-ef9fea758205 tempest-VolumesActionsTest-1665182479 tempest-VolumesActionsTest-1665182479-project] [instance: 41985a43-8b24-478a-8b18-c8559af076c9] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:56:20.967361 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-8f102b3d-539b-4855-aa9e-ef9fea758205 tempest-VolumesActionsTest-1665182479 tempest-VolumesActionsTest-1665182479-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:56:20.967802 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-8f102b3d-539b-4855-aa9e-ef9fea758205 tempest-VolumesActionsTest-1665182479 tempest-VolumesActionsTest-1665182479-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:56:20.969494 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-8f102b3d-539b-4855-aa9e-ef9fea758205 tempest-VolumesActionsTest-1665182479 tempest-VolumesActionsTest-1665182479-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:56:20.970060 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-8f102b3d-539b-4855-aa9e-ef9fea758205 tempest-VolumesActionsTest-1665182479 tempest-VolumesActionsTest-1665182479-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:56:21.187918 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-2e0155d0-7d09-4b8c-984b-853262ab6fd3 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:56:21.188791 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-2e0155d0-7d09-4b8c-984b-853262ab6fd3 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] [instance: a3aeae5c-d73d-4fb3-afa0-ee691e6a4fd4] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:56:21.195722 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-2e0155d0-7d09-4b8c-984b-853262ab6fd3 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:56:21.196159 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-2e0155d0-7d09-4b8c-984b-853262ab6fd3 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:56:21.196910 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-2e0155d0-7d09-4b8c-984b-853262ab6fd3 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:56:21.197393 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-2e0155d0-7d09-4b8c-984b-853262ab6fd3 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:56:21.206558 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-8f102b3d-539b-4855-aa9e-ef9fea758205 tempest-VolumesActionsTest-1665182479 tempest-VolumesActionsTest-1665182479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd273630a84d41f49dcf8208c618f256', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a407f0bf436c4987b9eb2e59c46d82a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:56:21.214603 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-8f102b3d-539b-4855-aa9e-ef9fea758205 tempest-VolumesActionsTest-1665182479 tempest-VolumesActionsTest-1665182479-project] 10.222.0.20 "GET /compute/v2.1/servers/41985a43-8b24-478a-8b18-c8559af076c9" status: 200 len: 1314 microversion: 2.1 time: 0.261669 Jul 05 20:56:21.215333 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 123/234] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:56:20 2022] GET /compute/v2.1/servers/41985a43-8b24-478a-8b18-c8559af076c9 => generated 1314 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 20:56:21.538393 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-2e0155d0-7d09-4b8c-984b-853262ab6fd3 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd152763a64794301b21587ab2b395bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc6d47f96d17471d94367bc8f8a3e3f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:56:21.546665 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-2e0155d0-7d09-4b8c-984b-853262ab6fd3 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] 10.222.0.20 "GET /compute/v2.1/servers/a3aeae5c-d73d-4fb3-afa0-ee691e6a4fd4" status: 200 len: 1511 microversion: 2.1 time: 0.363080 Jul 05 20:56:21.547915 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 112/235] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:56:21 2022] GET /compute/v2.1/servers/a3aeae5c-d73d-4fb3-afa0-ee691e6a4fd4 => generated 1511 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 20:56:21.974197 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-c008ae42-399d-4ec3-a919-2c485c3173e0 tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1769428113", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-672009384", "security_groups": [{"name": "tempest-secgroup-smoke-90772449"}], "networks": [{"uuid": "3af58350-f8bf-47a7-bc00-ddc42a7e241d"}], "block_device_mapping_v2": [{"uuid": "de8b063e-7ecf-4de7-b884-81529d196813", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 20:56:22.098059 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.network.neutron [None req-c008ae42-399d-4ec3-a919-2c485c3173e0 tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] validate_networks() for [('3af58350-f8bf-47a7-bc00-ddc42a7e241d', None, None, None, None, None)] {{(pid=117628) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 05 20:56:22.233288 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-c5e4a0d4-7f2a-422b-a3e0-2e99fb14591b tempest-VolumesActionsTest-1665182479 tempest-VolumesActionsTest-1665182479-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:56:22.236167 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-c5e4a0d4-7f2a-422b-a3e0-2e99fb14591b tempest-VolumesActionsTest-1665182479 tempest-VolumesActionsTest-1665182479-project] [instance: 41985a43-8b24-478a-8b18-c8559af076c9] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:56:22.249951 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-c5e4a0d4-7f2a-422b-a3e0-2e99fb14591b tempest-VolumesActionsTest-1665182479 tempest-VolumesActionsTest-1665182479-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:56:22.250661 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-c5e4a0d4-7f2a-422b-a3e0-2e99fb14591b tempest-VolumesActionsTest-1665182479 tempest-VolumesActionsTest-1665182479-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:56:22.251596 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-c5e4a0d4-7f2a-422b-a3e0-2e99fb14591b tempest-VolumesActionsTest-1665182479 tempest-VolumesActionsTest-1665182479-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:56:22.252741 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-c5e4a0d4-7f2a-422b-a3e0-2e99fb14591b tempest-VolumesActionsTest-1665182479 tempest-VolumesActionsTest-1665182479-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:56:22.696352 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-c5e4a0d4-7f2a-422b-a3e0-2e99fb14591b tempest-VolumesActionsTest-1665182479 tempest-VolumesActionsTest-1665182479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd273630a84d41f49dcf8208c618f256', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a407f0bf436c4987b9eb2e59c46d82a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:56:22.703855 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-c5e4a0d4-7f2a-422b-a3e0-2e99fb14591b tempest-VolumesActionsTest-1665182479 tempest-VolumesActionsTest-1665182479-project] 10.222.0.20 "GET /compute/v2.1/servers/41985a43-8b24-478a-8b18-c8559af076c9" status: 200 len: 1314 microversion: 2.1 time: 0.475082 Jul 05 20:56:22.704426 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 113/236] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:56:22 2022] GET /compute/v2.1/servers/41985a43-8b24-478a-8b18-c8559af076c9 => generated 1314 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 20:56:22.709274 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-39d77026-0126-455d-af83-bf4cf960b98f tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:56:22.710094 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-39d77026-0126-455d-af83-bf4cf960b98f tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] [instance: a3aeae5c-d73d-4fb3-afa0-ee691e6a4fd4] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:56:22.717826 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-39d77026-0126-455d-af83-bf4cf960b98f tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:56:22.718278 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-39d77026-0126-455d-af83-bf4cf960b98f tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:56:22.719082 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-39d77026-0126-455d-af83-bf4cf960b98f tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:56:22.719513 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-39d77026-0126-455d-af83-bf4cf960b98f tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:56:23.013676 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-39d77026-0126-455d-af83-bf4cf960b98f tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd152763a64794301b21587ab2b395bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc6d47f96d17471d94367bc8f8a3e3f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:56:23.023505 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-39d77026-0126-455d-af83-bf4cf960b98f tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] 10.222.0.20 "GET /compute/v2.1/servers/a3aeae5c-d73d-4fb3-afa0-ee691e6a4fd4" status: 200 len: 1517 microversion: 2.1 time: 0.317716 Jul 05 20:56:23.024381 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 114/237] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:56:22 2022] GET /compute/v2.1/servers/a3aeae5c-d73d-4fb3-afa0-ee691e6a4fd4 => generated 1517 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 20:56:23.029971 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.virt.hardware [None req-c008ae42-399d-4ec3-a919-2c485c3173e0 tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Flavor limits 0:0:0 {{(pid=117628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 05 20:56:23.030466 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.virt.hardware [None req-c008ae42-399d-4ec3-a919-2c485c3173e0 tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Image limits 0:0:0 {{(pid=117628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 05 20:56:23.030842 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.virt.hardware [None req-c008ae42-399d-4ec3-a919-2c485c3173e0 tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Flavor pref 0:0:0 {{(pid=117628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 05 20:56:23.031274 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.virt.hardware [None req-c008ae42-399d-4ec3-a919-2c485c3173e0 tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Image pref 0:0:0 {{(pid=117628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 05 20:56:23.031685 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.virt.hardware [None req-c008ae42-399d-4ec3-a919-2c485c3173e0 tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 05 20:56:23.041016 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-c008ae42-399d-4ec3-a919-2c485c3173e0 tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:56:23.041466 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-c008ae42-399d-4ec3-a919-2c485c3173e0 tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:56:23.042253 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-c008ae42-399d-4ec3-a919-2c485c3173e0 tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:56:23.042684 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-c008ae42-399d-4ec3-a919-2c485c3173e0 tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:56:23.069094 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.quota [None req-c008ae42-399d-4ec3-a919-2c485c3173e0 tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Getting quotas for project 3429e99ac2a94266b152e053bc6a0006. Resources: {'cores', 'ram', 'instances'} {{(pid=117628) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 05 20:56:23.074230 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.quota [None req-c008ae42-399d-4ec3-a919-2c485c3173e0 tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Getting quotas for user 7a4b471d14044069a5969e8bc6ca4f2d and project 3429e99ac2a94266b152e053bc6a0006. Resources: {'cores', 'ram', 'instances'} {{(pid=117628) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 05 20:56:23.141389 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-c008ae42-399d-4ec3-a919-2c485c3173e0 tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Going to run 1 instances... {{(pid=117628) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 05 20:56:23.143464 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-c008ae42-399d-4ec3-a919-2c485c3173e0 tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] [instance: 7b18289e-137f-467c-96ec-cc6179f93e17] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='de8b063e-7ecf-4de7-b884-81529d196813',volume_size=None,volume_type=None)] {{(pid=117628) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 05 20:56:23.353602 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-c008ae42-399d-4ec3-a919-2c485c3173e0 tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 1.381394 Jul 05 20:56:23.355767 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 124/238] 10.222.0.20 () {60 vars in 1146 bytes} [Tue Jul 5 20:56:21 2022] POST /compute/v2.1/servers => generated 404 bytes in 1386 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 05 20:56:23.366332 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-24d4e14c-fd44-4e57-b5c1-0191fa463525 tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:56:23.375874 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-24d4e14c-fd44-4e57-b5c1-0191fa463525 tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] [instance: 7b18289e-137f-467c-96ec-cc6179f93e17] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:56:23.521999 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-0e1947f7-ef8f-4e6c-82a9-9e5d403add4c tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b424f0cb-3204-41fa-84b5-457d772502f2"}} {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 20:56:23.524086 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-0e1947f7-ef8f-4e6c-82a9-9e5d403add4c tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] [instance: f236112c-4649-478b-a626-b84f8ff1bfe9] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:56:23.525220 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-24d4e14c-fd44-4e57-b5c1-0191fa463525 tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a4b471d14044069a5969e8bc6ca4f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3429e99ac2a94266b152e053bc6a0006', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:56:23.533430 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-0e1947f7-ef8f-4e6c-82a9-9e5d403add4c tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:56:23.533940 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-0e1947f7-ef8f-4e6c-82a9-9e5d403add4c tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:56:23.534918 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-0e1947f7-ef8f-4e6c-82a9-9e5d403add4c tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:56:23.535466 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-24d4e14c-fd44-4e57-b5c1-0191fa463525 tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] 10.222.0.20 "GET /compute/v2.1/servers/7b18289e-137f-467c-96ec-cc6179f93e17" status: 200 len: 1088 microversion: 2.1 time: 0.173334 Jul 05 20:56:23.535779 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-0e1947f7-ef8f-4e6c-82a9-9e5d403add4c tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:56:23.537207 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 115/239] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:56:23 2022] GET /compute/v2.1/servers/7b18289e-137f-467c-96ec-cc6179f93e17 => generated 1088 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 20:56:23.725379 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-f0e8d7ab-0ec6-4645-9b40-989e0707ba70 tempest-VolumesActionsTest-1665182479 tempest-VolumesActionsTest-1665182479-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:56:23.726210 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-f0e8d7ab-0ec6-4645-9b40-989e0707ba70 tempest-VolumesActionsTest-1665182479 tempest-VolumesActionsTest-1665182479-project] [instance: 41985a43-8b24-478a-8b18-c8559af076c9] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:56:23.737242 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-f0e8d7ab-0ec6-4645-9b40-989e0707ba70 tempest-VolumesActionsTest-1665182479 tempest-VolumesActionsTest-1665182479-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:56:23.737705 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-f0e8d7ab-0ec6-4645-9b40-989e0707ba70 tempest-VolumesActionsTest-1665182479 tempest-VolumesActionsTest-1665182479-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:56:23.738652 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-f0e8d7ab-0ec6-4645-9b40-989e0707ba70 tempest-VolumesActionsTest-1665182479 tempest-VolumesActionsTest-1665182479-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:56:23.739151 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-f0e8d7ab-0ec6-4645-9b40-989e0707ba70 tempest-VolumesActionsTest-1665182479 tempest-VolumesActionsTest-1665182479-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:56:23.911903 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-f0e8d7ab-0ec6-4645-9b40-989e0707ba70 tempest-VolumesActionsTest-1665182479 tempest-VolumesActionsTest-1665182479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd273630a84d41f49dcf8208c618f256', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a407f0bf436c4987b9eb2e59c46d82a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:56:23.919442 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-f0e8d7ab-0ec6-4645-9b40-989e0707ba70 tempest-VolumesActionsTest-1665182479 tempest-VolumesActionsTest-1665182479-project] 10.222.0.20 "GET /compute/v2.1/servers/41985a43-8b24-478a-8b18-c8559af076c9" status: 200 len: 1314 microversion: 2.1 time: 0.201340 Jul 05 20:56:23.920295 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 116/240] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:56:23 2022] GET /compute/v2.1/servers/41985a43-8b24-478a-8b18-c8559af076c9 => generated 1314 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 20:56:24.461428 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-84a680a5-2e19-4bf7-a1d9-5b27ff538904 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Action: 'create', calling method: .version_select at 0x7f57ce9f8040>, body: {"keypair": {"name": "tempest-keypair-1065538285", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOiX/magbGVkgy0Voro1fAzzK8oPQt1zUUHMmbrVP/NmAJCwHX1ulqCI1j/TNSEPsxDYIlX0FOvhY7d4S4XpPxEbLaMwMIy5b3d4Kghz+rTgNvnRj9KXLcozLEExil6qMw=="}} {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 20:56:24.482863 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.quota [None req-84a680a5-2e19-4bf7-a1d9-5b27ff538904 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Getting quotas for project fc6d47f96d17471d94367bc8f8a3e3f6. Resources: {'key_pairs'} {{(pid=117627) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 05 20:56:24.488173 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.quota [None req-84a680a5-2e19-4bf7-a1d9-5b27ff538904 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Getting quotas for user d152763a64794301b21587ab2b395bbf and project fc6d47f96d17471d94367bc8f8a3e3f6. Resources: {'key_pairs'} {{(pid=117627) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 05 20:56:24.537833 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-84a680a5-2e19-4bf7-a1d9-5b27ff538904 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.080407 Jul 05 20:56:24.538631 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 117/241] 10.222.0.20 () {60 vars in 1158 bytes} [Tue Jul 5 20:56:24 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 20:56:24.556212 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-a04a1ee7-37e2-4656-ab07-c3fffb039656 tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:56:24.557726 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-a04a1ee7-37e2-4656-ab07-c3fffb039656 tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] [instance: 7b18289e-137f-467c-96ec-cc6179f93e17] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:56:24.567562 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-a04a1ee7-37e2-4656-ab07-c3fffb039656 tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:56:24.568374 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-a04a1ee7-37e2-4656-ab07-c3fffb039656 tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:56:24.569673 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-a04a1ee7-37e2-4656-ab07-c3fffb039656 tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:56:24.570896 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-a04a1ee7-37e2-4656-ab07-c3fffb039656 tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:56:24.684216 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-a04a1ee7-37e2-4656-ab07-c3fffb039656 tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a4b471d14044069a5969e8bc6ca4f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3429e99ac2a94266b152e053bc6a0006', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:56:24.699635 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-a04a1ee7-37e2-4656-ab07-c3fffb039656 tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] 10.222.0.20 "GET /compute/v2.1/servers/7b18289e-137f-467c-96ec-cc6179f93e17" status: 200 len: 1138 microversion: 2.1 time: 0.149083 Jul 05 20:56:24.709693 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 118/242] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:56:24 2022] GET /compute/v2.1/servers/7b18289e-137f-467c-96ec-cc6179f93e17 => generated 1138 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 20:56:24.898239 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-0e1947f7-ef8f-4e6c-82a9-9e5d403add4c tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] 10.222.0.20 "POST /compute/v2.1/servers/f236112c-4649-478b-a626-b84f8ff1bfe9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.384070 Jul 05 20:56:24.898859 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 125/243] 10.222.0.20 () {60 vars in 1322 bytes} [Tue Jul 5 20:56:23 2022] POST /compute/v2.1/servers/f236112c-4649-478b-a626-b84f8ff1bfe9/os-volume_attachments => generated 194 bytes in 1386 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 20:56:24.939763 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-695da541-b61d-450f-8589-7758faf0b637 tempest-VolumesActionsTest-1665182479 tempest-VolumesActionsTest-1665182479-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:56:24.940796 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-695da541-b61d-450f-8589-7758faf0b637 tempest-VolumesActionsTest-1665182479 tempest-VolumesActionsTest-1665182479-project] [instance: 41985a43-8b24-478a-8b18-c8559af076c9] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:56:24.949797 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-695da541-b61d-450f-8589-7758faf0b637 tempest-VolumesActionsTest-1665182479 tempest-VolumesActionsTest-1665182479-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:56:24.950637 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-695da541-b61d-450f-8589-7758faf0b637 tempest-VolumesActionsTest-1665182479 tempest-VolumesActionsTest-1665182479-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:56:24.951631 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-695da541-b61d-450f-8589-7758faf0b637 tempest-VolumesActionsTest-1665182479 tempest-VolumesActionsTest-1665182479-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:56:24.952276 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-695da541-b61d-450f-8589-7758faf0b637 tempest-VolumesActionsTest-1665182479 tempest-VolumesActionsTest-1665182479-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:56:25.203716 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG dbcounter [-] [117627] Writing DB stats nova_cell0:SELECT=2 {{(pid=117627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:56:25.276581 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-695da541-b61d-450f-8589-7758faf0b637 tempest-VolumesActionsTest-1665182479 tempest-VolumesActionsTest-1665182479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd273630a84d41f49dcf8208c618f256', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a407f0bf436c4987b9eb2e59c46d82a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:56:25.287165 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-695da541-b61d-450f-8589-7758faf0b637 tempest-VolumesActionsTest-1665182479 tempest-VolumesActionsTest-1665182479-project] 10.222.0.20 "GET /compute/v2.1/servers/41985a43-8b24-478a-8b18-c8559af076c9" status: 200 len: 1314 microversion: 2.1 time: 0.351824 Jul 05 20:56:25.288068 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 119/244] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:56:24 2022] GET /compute/v2.1/servers/41985a43-8b24-478a-8b18-c8559af076c9 => generated 1314 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 20:56:25.517765 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-44e8ac11-dc9d-460f-810f-4b6975451b4e tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:56:25.518552 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-44e8ac11-dc9d-460f-810f-4b6975451b4e tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] [instance: 52848078-62a1-484f-813c-7b3352cb3851] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:56:25.533019 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-44e8ac11-dc9d-460f-810f-4b6975451b4e tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:56:25.533433 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-44e8ac11-dc9d-460f-810f-4b6975451b4e tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:56:25.534217 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-44e8ac11-dc9d-460f-810f-4b6975451b4e tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:56:25.534665 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-44e8ac11-dc9d-460f-810f-4b6975451b4e tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:56:25.581925 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-44e8ac11-dc9d-460f-810f-4b6975451b4e tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] 10.222.0.20 "GET /compute/v2.1/servers/52848078-62a1-484f-813c-7b3352cb3851/ips" status: 200 len: 152 microversion: 2.20 time: 0.068917 Jul 05 20:56:25.582651 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 126/245] 10.222.0.20 () {60 vars in 1288 bytes} [Tue Jul 5 20:56:25 2022] GET /compute/v2.1/servers/52848078-62a1-484f-813c-7b3352cb3851/ips => generated 152 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 05 20:56:25.716769 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-a93e1af5-0430-4512-888d-14294c707038 tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:56:25.717405 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-a93e1af5-0430-4512-888d-14294c707038 tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] [instance: 7b18289e-137f-467c-96ec-cc6179f93e17] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:56:25.733262 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-a93e1af5-0430-4512-888d-14294c707038 tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:56:25.734745 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-a93e1af5-0430-4512-888d-14294c707038 tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:56:25.736091 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-a93e1af5-0430-4512-888d-14294c707038 tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:56:25.736772 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-a93e1af5-0430-4512-888d-14294c707038 tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:56:25.874340 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-a93e1af5-0430-4512-888d-14294c707038 tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a4b471d14044069a5969e8bc6ca4f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3429e99ac2a94266b152e053bc6a0006', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:56:25.883679 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-a93e1af5-0430-4512-888d-14294c707038 tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] 10.222.0.20 "GET /compute/v2.1/servers/7b18289e-137f-467c-96ec-cc6179f93e17" status: 200 len: 1204 microversion: 2.1 time: 0.170408 Jul 05 20:56:25.884247 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 120/246] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:56:25 2022] GET /compute/v2.1/servers/7b18289e-137f-467c-96ec-cc6179f93e17 => generated 1204 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 20:56:26.304111 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-9fc08786-6642-4091-a7e5-9dc1303a2187 tempest-VolumesActionsTest-1665182479 tempest-VolumesActionsTest-1665182479-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:56:26.305387 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-9fc08786-6642-4091-a7e5-9dc1303a2187 tempest-VolumesActionsTest-1665182479 tempest-VolumesActionsTest-1665182479-project] [instance: 41985a43-8b24-478a-8b18-c8559af076c9] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:56:26.312310 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-9fc08786-6642-4091-a7e5-9dc1303a2187 tempest-VolumesActionsTest-1665182479 tempest-VolumesActionsTest-1665182479-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:56:26.313044 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-9fc08786-6642-4091-a7e5-9dc1303a2187 tempest-VolumesActionsTest-1665182479 tempest-VolumesActionsTest-1665182479-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:56:26.313835 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-9fc08786-6642-4091-a7e5-9dc1303a2187 tempest-VolumesActionsTest-1665182479 tempest-VolumesActionsTest-1665182479-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:56:26.314270 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-9fc08786-6642-4091-a7e5-9dc1303a2187 tempest-VolumesActionsTest-1665182479 tempest-VolumesActionsTest-1665182479-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:56:26.642684 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-9fc08786-6642-4091-a7e5-9dc1303a2187 tempest-VolumesActionsTest-1665182479 tempest-VolumesActionsTest-1665182479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd273630a84d41f49dcf8208c618f256', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a407f0bf436c4987b9eb2e59c46d82a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:56:26.667117 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-9fc08786-6642-4091-a7e5-9dc1303a2187 tempest-VolumesActionsTest-1665182479 tempest-VolumesActionsTest-1665182479-project] 10.222.0.20 "GET /compute/v2.1/servers/41985a43-8b24-478a-8b18-c8559af076c9" status: 200 len: 1314 microversion: 2.1 time: 0.366827 Jul 05 20:56:26.667712 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 127/247] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:56:26 2022] GET /compute/v2.1/servers/41985a43-8b24-478a-8b18-c8559af076c9 => generated 1314 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 20:56:26.732726 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-31138482-5421-4a5e-bf85-9a3c4719c444 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-11293141", "imageRef": "88e08f49-c01d-4849-a89f-b678588e56f4", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b7580cfc-ddfa-4e5a-84ac-e60422771b4c"}], "security_groups": [{"name": "tempest-securitygroup--1365023676"}], "key_name": "tempest-keypair-1065538285", "user_data": "}} {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 20:56:26.910833 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-0dff4b8e-9a70-4f76-869b-178f6f55167d tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:56:26.911831 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-0dff4b8e-9a70-4f76-869b-178f6f55167d tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] [instance: 7b18289e-137f-467c-96ec-cc6179f93e17] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:56:26.923496 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-0dff4b8e-9a70-4f76-869b-178f6f55167d tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:56:26.924618 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-0dff4b8e-9a70-4f76-869b-178f6f55167d tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:56:26.926133 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-0dff4b8e-9a70-4f76-869b-178f6f55167d tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:56:26.927074 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-0dff4b8e-9a70-4f76-869b-178f6f55167d tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:56:26.951130 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.network.neutron [None req-31138482-5421-4a5e-bf85-9a3c4719c444 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] validate_networks() for [('b7580cfc-ddfa-4e5a-84ac-e60422771b4c', None, None, None, None, None)] {{(pid=117627) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 05 20:56:27.777728 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-0dff4b8e-9a70-4f76-869b-178f6f55167d tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a4b471d14044069a5969e8bc6ca4f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3429e99ac2a94266b152e053bc6a0006', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:56:27.786253 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-0dff4b8e-9a70-4f76-869b-178f6f55167d tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] 10.222.0.20 "GET /compute/v2.1/servers/7b18289e-137f-467c-96ec-cc6179f93e17" status: 200 len: 1270 microversion: 2.1 time: 0.888969 Jul 05 20:56:27.790848 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 128/248] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:56:26 2022] GET /compute/v2.1/servers/7b18289e-137f-467c-96ec-cc6179f93e17 => generated 1270 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 20:56:27.798832 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-07518e4d-9b38-4b09-982b-b15c8e9f9e6b tempest-VolumesActionsTest-1665182479 tempest-VolumesActionsTest-1665182479-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:56:27.799806 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-07518e4d-9b38-4b09-982b-b15c8e9f9e6b tempest-VolumesActionsTest-1665182479 tempest-VolumesActionsTest-1665182479-project] [instance: 41985a43-8b24-478a-8b18-c8559af076c9] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:56:27.803887 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG dbcounter [-] [117628] Writing DB stats nova_api:SELECT=57,nova_api:INSERT=3 {{(pid=117628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:56:27.811460 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-07518e4d-9b38-4b09-982b-b15c8e9f9e6b tempest-VolumesActionsTest-1665182479 tempest-VolumesActionsTest-1665182479-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:56:27.812719 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-07518e4d-9b38-4b09-982b-b15c8e9f9e6b tempest-VolumesActionsTest-1665182479 tempest-VolumesActionsTest-1665182479-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:56:27.813776 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-07518e4d-9b38-4b09-982b-b15c8e9f9e6b tempest-VolumesActionsTest-1665182479 tempest-VolumesActionsTest-1665182479-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:56:27.814433 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-07518e4d-9b38-4b09-982b-b15c8e9f9e6b tempest-VolumesActionsTest-1665182479 tempest-VolumesActionsTest-1665182479-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:56:28.199826 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-07518e4d-9b38-4b09-982b-b15c8e9f9e6b tempest-VolumesActionsTest-1665182479 tempest-VolumesActionsTest-1665182479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd273630a84d41f49dcf8208c618f256', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a407f0bf436c4987b9eb2e59c46d82a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:56:28.213026 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-07518e4d-9b38-4b09-982b-b15c8e9f9e6b tempest-VolumesActionsTest-1665182479 tempest-VolumesActionsTest-1665182479-project] 10.222.0.20 "GET /compute/v2.1/servers/41985a43-8b24-478a-8b18-c8559af076c9" status: 200 len: 1314 microversion: 2.1 time: 0.420031 Jul 05 20:56:28.214029 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 129/249] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:56:27 2022] GET /compute/v2.1/servers/41985a43-8b24-478a-8b18-c8559af076c9 => generated 1314 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 20:56:28.231974 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-34d6ff3f-f90e-4da8-bbc5-6c6e5fb9d86b tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 20:56:28.233400 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-34d6ff3f-f90e-4da8-bbc5-6c6e5fb9d86b tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] [instance: 52848078-62a1-484f-813c-7b3352cb3851] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:56:28.242466 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.virt.hardware [None req-31138482-5421-4a5e-bf85-9a3c4719c444 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Flavor limits 0:0:0 {{(pid=117627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 05 20:56:28.242976 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.virt.hardware [None req-31138482-5421-4a5e-bf85-9a3c4719c444 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Image limits 0:0:0 {{(pid=117627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 05 20:56:28.243502 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-34d6ff3f-f90e-4da8-bbc5-6c6e5fb9d86b tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:56:28.244068 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.virt.hardware [None req-31138482-5421-4a5e-bf85-9a3c4719c444 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Flavor pref 0:0:0 {{(pid=117627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 05 20:56:28.244287 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-34d6ff3f-f90e-4da8-bbc5-6c6e5fb9d86b tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:56:28.245128 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.virt.hardware [None req-31138482-5421-4a5e-bf85-9a3c4719c444 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Image pref 0:0:0 {{(pid=117627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 05 20:56:28.245581 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-34d6ff3f-f90e-4da8-bbc5-6c6e5fb9d86b tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:56:28.245746 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.virt.hardware [None req-31138482-5421-4a5e-bf85-9a3c4719c444 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 05 20:56:28.246784 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-34d6ff3f-f90e-4da8-bbc5-6c6e5fb9d86b tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:56:28.266250 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-31138482-5421-4a5e-bf85-9a3c4719c444 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:56:28.266851 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-31138482-5421-4a5e-bf85-9a3c4719c444 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:56:28.269175 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-31138482-5421-4a5e-bf85-9a3c4719c444 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:56:28.269808 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-31138482-5421-4a5e-bf85-9a3c4719c444 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:56:28.281639 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.objects.instance [None req-34d6ff3f-f90e-4da8-bbc5-6c6e5fb9d86b tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lazy-loading 'flavor' on Instance uuid 52848078-62a1-484f-813c-7b3352cb3851 {{(pid=117628) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 05 20:56:28.312753 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.quota [None req-31138482-5421-4a5e-bf85-9a3c4719c444 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Getting quotas for project fc6d47f96d17471d94367bc8f8a3e3f6. Resources: {'cores', 'ram', 'instances'} {{(pid=117627) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 05 20:56:28.327106 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.quota [None req-31138482-5421-4a5e-bf85-9a3c4719c444 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Getting quotas for user d152763a64794301b21587ab2b395bbf and project fc6d47f96d17471d94367bc8f8a3e3f6. Resources: {'cores', 'ram', 'instances'} {{(pid=117627) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 05 20:56:28.348561 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-31138482-5421-4a5e-bf85-9a3c4719c444 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Going to run 1 instances... {{(pid=117627) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 05 20:56:28.351126 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-31138482-5421-4a5e-bf85-9a3c4719c444 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] [instance: c6c3c1ea-31e8-4c65-b73d-669f337bee2f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='88e08f49-c01d-4849-a89f-b678588e56f4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117627) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 05 20:56:28.406642 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG dbcounter [-] [117628] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=5,nova_cell1:INSERT=2 {{(pid=117628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:56:28.448594 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-31138482-5421-4a5e-bf85-9a3c4719c444 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.719202 Jul 05 20:56:28.449900 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 121/250] 10.222.0.20 () {60 vars in 1146 bytes} [Tue Jul 5 20:56:26 2022] POST /compute/v2.1/servers => generated 409 bytes in 1722 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 05 20:56:28.479076 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-0586fb75-d130-42a8-a626-efad5f515254 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:56:28.479953 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-0586fb75-d130-42a8-a626-efad5f515254 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] [instance: c6c3c1ea-31e8-4c65-b73d-669f337bee2f] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:56:28.674332 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-0586fb75-d130-42a8-a626-efad5f515254 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd152763a64794301b21587ab2b395bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc6d47f96d17471d94367bc8f8a3e3f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:56:28.683291 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-0586fb75-d130-42a8-a626-efad5f515254 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] 10.222.0.20 "GET /compute/v2.1/servers/c6c3c1ea-31e8-4c65-b73d-669f337bee2f" status: 200 len: 1244 microversion: 2.1 time: 0.226237 Jul 05 20:56:28.684600 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 122/251] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:56:28 2022] GET /compute/v2.1/servers/c6c3c1ea-31e8-4c65-b73d-669f337bee2f => generated 1244 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 20:56:28.752369 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-34d6ff3f-f90e-4da8-bbc5-6c6e5fb9d86b tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] 10.222.0.20 "POST /compute/v2.1/servers/52848078-62a1-484f-813c-7b3352cb3851/action" status: 202 len: 0 microversion: 2.20 time: 0.525194 Jul 05 20:56:28.757849 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 130/252] 10.222.0.20 () {62 vars in 1318 bytes} [Tue Jul 5 20:56:28 2022] POST /compute/v2.1/servers/52848078-62a1-484f-813c-7b3352cb3851/action => generated 0 bytes in 532 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 05 20:56:28.762757 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-1cad266c-2dc6-424d-abf6-a3d8fc6fc092 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:56:28.763834 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-1cad266c-2dc6-424d-abf6-a3d8fc6fc092 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] [instance: 52848078-62a1-484f-813c-7b3352cb3851] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:56:28.777157 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-1cad266c-2dc6-424d-abf6-a3d8fc6fc092 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:56:28.777612 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-1cad266c-2dc6-424d-abf6-a3d8fc6fc092 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:56:28.778388 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-1cad266c-2dc6-424d-abf6-a3d8fc6fc092 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:56:28.782209 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-1cad266c-2dc6-424d-abf6-a3d8fc6fc092 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:56:28.807196 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-44b73846-dc0e-4fbf-bbee-6bfadf97145a tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:56:28.808677 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-44b73846-dc0e-4fbf-bbee-6bfadf97145a tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] [instance: 7b18289e-137f-467c-96ec-cc6179f93e17] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:56:28.815567 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG dbcounter [-] [117627] Writing DB stats nova_cell1:SELECT=100 {{(pid=117627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:56:28.817214 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-44b73846-dc0e-4fbf-bbee-6bfadf97145a tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:56:28.817889 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-44b73846-dc0e-4fbf-bbee-6bfadf97145a tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:56:28.825176 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-44b73846-dc0e-4fbf-bbee-6bfadf97145a tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:56:28.825915 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-44b73846-dc0e-4fbf-bbee-6bfadf97145a tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:56:29.267985 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-1cad266c-2dc6-424d-abf6-a3d8fc6fc092 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:56:29.280680 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-44b73846-dc0e-4fbf-bbee-6bfadf97145a tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a4b471d14044069a5969e8bc6ca4f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3429e99ac2a94266b152e053bc6a0006', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:56:29.301907 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-44b73846-dc0e-4fbf-bbee-6bfadf97145a tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] 10.222.0.20 "GET /compute/v2.1/servers/7b18289e-137f-467c-96ec-cc6179f93e17" status: 200 len: 1270 microversion: 2.1 time: 0.493094 Jul 05 20:56:29.302515 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 131/253] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:56:28 2022] GET /compute/v2.1/servers/7b18289e-137f-467c-96ec-cc6179f93e17 => generated 1270 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 20:56:29.316135 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-1cad266c-2dc6-424d-abf6-a3d8fc6fc092 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:56:29.321359 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-1cad266c-2dc6-424d-abf6-a3d8fc6fc092 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:56:29.324737 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [req-12ff3420-9fc0-48b3-9435-d20bbd98f90a req-595c7adb-d6f5-4cff-8baf-c5f481842f4f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41985a43-8b24-478a-8b18-c8559af076c9", "name": "network-vif-plugged", "status": "completed", "tag": "776baae1-5f4b-45c1-b0d2-5591f34aba38"}]} {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 20:56:29.327598 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-1cad266c-2dc6-424d-abf6-a3d8fc6fc092 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] 10.222.0.20 "GET /compute/v2.1/servers/52848078-62a1-484f-813c-7b3352cb3851" status: 200 len: 1719 microversion: 2.20 time: 0.565749 Jul 05 20:56:29.333402 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 123/254] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 5 20:56:28 2022] GET /compute/v2.1/servers/52848078-62a1-484f-813c-7b3352cb3851 => generated 1719 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 05 20:56:29.352618 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-53b238fd-4882-4574-8e88-4c6daa8bbb06 tempest-VolumesActionsTest-1665182479 tempest-VolumesActionsTest-1665182479-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:56:29.353592 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-53b238fd-4882-4574-8e88-4c6daa8bbb06 tempest-VolumesActionsTest-1665182479 tempest-VolumesActionsTest-1665182479-project] [instance: 41985a43-8b24-478a-8b18-c8559af076c9] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:56:29.355655 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [req-12ff3420-9fc0-48b3-9435-d20bbd98f90a req-595c7adb-d6f5-4cff-8baf-c5f481842f4f service nova] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:56:29.358579 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [req-12ff3420-9fc0-48b3-9435-d20bbd98f90a req-595c7adb-d6f5-4cff-8baf-c5f481842f4f service nova] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:56:29.368006 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-53b238fd-4882-4574-8e88-4c6daa8bbb06 tempest-VolumesActionsTest-1665182479 tempest-VolumesActionsTest-1665182479-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:56:29.370061 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-53b238fd-4882-4574-8e88-4c6daa8bbb06 tempest-VolumesActionsTest-1665182479 tempest-VolumesActionsTest-1665182479-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:56:29.370965 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-53b238fd-4882-4574-8e88-4c6daa8bbb06 tempest-VolumesActionsTest-1665182479 tempest-VolumesActionsTest-1665182479-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:56:29.374156 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-53b238fd-4882-4574-8e88-4c6daa8bbb06 tempest-VolumesActionsTest-1665182479 tempest-VolumesActionsTest-1665182479-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:56:29.390030 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.compute.server_external_events [req-12ff3420-9fc0-48b3-9435-d20bbd98f90a req-595c7adb-d6f5-4cff-8baf-c5f481842f4f service nova] Creating event network-vif-plugged:776baae1-5f4b-45c1-b0d2-5591f34aba38 for instance 41985a43-8b24-478a-8b18-c8559af076c9 on hv-cinder-79760 Jul 05 20:56:29.398572 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [req-12ff3420-9fc0-48b3-9435-d20bbd98f90a req-595c7adb-d6f5-4cff-8baf-c5f481842f4f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083287 Jul 05 20:56:29.399288 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 132/255] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 5 20:56:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 20:56:29.482978 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [req-7e0f7fd0-117d-4f1a-8810-5ee6a663a855 req-1f0892f3-8f35-4013-8e30-b69aa39ac15e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7b18289e-137f-467c-96ec-cc6179f93e17", "tag": "6b603e35-d2c5-47fc-83a0-12c2780e086f"}]} {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 20:56:29.511525 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [req-7e0f7fd0-117d-4f1a-8810-5ee6a663a855 req-1f0892f3-8f35-4013-8e30-b69aa39ac15e service nova] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:56:29.516457 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [req-7e0f7fd0-117d-4f1a-8810-5ee6a663a855 req-1f0892f3-8f35-4013-8e30-b69aa39ac15e service nova] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:56:29.562595 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.compute.server_external_events [req-7e0f7fd0-117d-4f1a-8810-5ee6a663a855 req-1f0892f3-8f35-4013-8e30-b69aa39ac15e service nova] Creating event network-changed:6b603e35-d2c5-47fc-83a0-12c2780e086f for instance 7b18289e-137f-467c-96ec-cc6179f93e17 on hv-cinder-79760 Jul 05 20:56:29.581976 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [req-7e0f7fd0-117d-4f1a-8810-5ee6a663a855 req-1f0892f3-8f35-4013-8e30-b69aa39ac15e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103649 Jul 05 20:56:29.590870 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 133/256] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 5 20:56:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 05 20:56:29.702251 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-90ed7f3f-7fac-449d-bdb5-5d3fec89ab0e tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:56:29.703449 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-90ed7f3f-7fac-449d-bdb5-5d3fec89ab0e tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] [instance: c6c3c1ea-31e8-4c65-b73d-669f337bee2f] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:56:29.723162 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-90ed7f3f-7fac-449d-bdb5-5d3fec89ab0e tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:56:29.724046 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-90ed7f3f-7fac-449d-bdb5-5d3fec89ab0e tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:56:29.725336 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-90ed7f3f-7fac-449d-bdb5-5d3fec89ab0e tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:56:29.726343 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-90ed7f3f-7fac-449d-bdb5-5d3fec89ab0e tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:56:29.867891 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-90ed7f3f-7fac-449d-bdb5-5d3fec89ab0e tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd152763a64794301b21587ab2b395bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc6d47f96d17471d94367bc8f8a3e3f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:56:29.878079 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-90ed7f3f-7fac-449d-bdb5-5d3fec89ab0e tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] 10.222.0.20 "GET /compute/v2.1/servers/c6c3c1ea-31e8-4c65-b73d-669f337bee2f" status: 200 len: 1296 microversion: 2.1 time: 0.180427 Jul 05 20:56:29.879425 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 134/257] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:56:29 2022] GET /compute/v2.1/servers/c6c3c1ea-31e8-4c65-b73d-669f337bee2f => generated 1296 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 20:56:29.912863 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-53b238fd-4882-4574-8e88-4c6daa8bbb06 tempest-VolumesActionsTest-1665182479 tempest-VolumesActionsTest-1665182479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd273630a84d41f49dcf8208c618f256', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a407f0bf436c4987b9eb2e59c46d82a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:56:29.920879 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-53b238fd-4882-4574-8e88-4c6daa8bbb06 tempest-VolumesActionsTest-1665182479 tempest-VolumesActionsTest-1665182479-project] 10.222.0.20 "GET /compute/v2.1/servers/41985a43-8b24-478a-8b18-c8559af076c9" status: 200 len: 1314 microversion: 2.1 time: 0.586074 Jul 05 20:56:29.922126 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 124/258] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:56:29 2022] GET /compute/v2.1/servers/41985a43-8b24-478a-8b18-c8559af076c9 => generated 1314 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 20:56:30.319237 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-98c5ff9e-a82e-4569-af42-fd376a6f95f2 tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:56:30.319855 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-98c5ff9e-a82e-4569-af42-fd376a6f95f2 tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] [instance: 7b18289e-137f-467c-96ec-cc6179f93e17] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:56:30.326292 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-98c5ff9e-a82e-4569-af42-fd376a6f95f2 tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:56:30.326842 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-98c5ff9e-a82e-4569-af42-fd376a6f95f2 tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:56:30.328272 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-98c5ff9e-a82e-4569-af42-fd376a6f95f2 tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:56:30.328791 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-98c5ff9e-a82e-4569-af42-fd376a6f95f2 tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:56:30.349788 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-066d5004-398b-4173-b80e-48aa27825977 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:56:30.350393 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-066d5004-398b-4173-b80e-48aa27825977 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] [instance: 52848078-62a1-484f-813c-7b3352cb3851] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:56:30.360606 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-066d5004-398b-4173-b80e-48aa27825977 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:56:30.361468 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-066d5004-398b-4173-b80e-48aa27825977 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:56:30.362497 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-066d5004-398b-4173-b80e-48aa27825977 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:56:30.363091 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-066d5004-398b-4173-b80e-48aa27825977 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:56:30.618311 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-98c5ff9e-a82e-4569-af42-fd376a6f95f2 tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a4b471d14044069a5969e8bc6ca4f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3429e99ac2a94266b152e053bc6a0006', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:56:30.628586 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-98c5ff9e-a82e-4569-af42-fd376a6f95f2 tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] 10.222.0.20 "GET /compute/v2.1/servers/7b18289e-137f-467c-96ec-cc6179f93e17" status: 200 len: 1270 microversion: 2.1 time: 0.312444 Jul 05 20:56:30.629877 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 135/259] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:56:30 2022] GET /compute/v2.1/servers/7b18289e-137f-467c-96ec-cc6179f93e17 => generated 1270 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 20:56:30.651739 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-066d5004-398b-4173-b80e-48aa27825977 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:56:30.662084 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-066d5004-398b-4173-b80e-48aa27825977 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:56:30.663578 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-066d5004-398b-4173-b80e-48aa27825977 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:56:30.664721 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-066d5004-398b-4173-b80e-48aa27825977 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] 10.222.0.20 "GET /compute/v2.1/servers/52848078-62a1-484f-813c-7b3352cb3851" status: 200 len: 1719 microversion: 2.20 time: 0.320982 Jul 05 20:56:30.665420 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 125/260] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 5 20:56:30 2022] GET /compute/v2.1/servers/52848078-62a1-484f-813c-7b3352cb3851 => generated 1719 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 20:56:30.898308 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-46f3c676-773b-4143-bd51-a7a8a0d74baa tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:56:30.898742 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-46f3c676-773b-4143-bd51-a7a8a0d74baa tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] [instance: c6c3c1ea-31e8-4c65-b73d-669f337bee2f] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:56:30.908176 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-46f3c676-773b-4143-bd51-a7a8a0d74baa tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:56:30.908634 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-46f3c676-773b-4143-bd51-a7a8a0d74baa tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:56:30.909433 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-46f3c676-773b-4143-bd51-a7a8a0d74baa tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:56:30.915197 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-46f3c676-773b-4143-bd51-a7a8a0d74baa tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:56:30.940565 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-2fd849a0-f828-48d3-9f02-6fe0c0781977 tempest-VolumesActionsTest-1665182479 tempest-VolumesActionsTest-1665182479-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:56:30.941417 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-2fd849a0-f828-48d3-9f02-6fe0c0781977 tempest-VolumesActionsTest-1665182479 tempest-VolumesActionsTest-1665182479-project] [instance: 41985a43-8b24-478a-8b18-c8559af076c9] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:56:30.948753 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-2fd849a0-f828-48d3-9f02-6fe0c0781977 tempest-VolumesActionsTest-1665182479 tempest-VolumesActionsTest-1665182479-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:56:30.949314 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-2fd849a0-f828-48d3-9f02-6fe0c0781977 tempest-VolumesActionsTest-1665182479 tempest-VolumesActionsTest-1665182479-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:56:30.950178 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-2fd849a0-f828-48d3-9f02-6fe0c0781977 tempest-VolumesActionsTest-1665182479 tempest-VolumesActionsTest-1665182479-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:56:30.951275 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-2fd849a0-f828-48d3-9f02-6fe0c0781977 tempest-VolumesActionsTest-1665182479 tempest-VolumesActionsTest-1665182479-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:56:31.080450 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-46f3c676-773b-4143-bd51-a7a8a0d74baa tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd152763a64794301b21587ab2b395bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc6d47f96d17471d94367bc8f8a3e3f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:56:31.090090 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-46f3c676-773b-4143-bd51-a7a8a0d74baa tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] 10.222.0.20 "GET /compute/v2.1/servers/c6c3c1ea-31e8-4c65-b73d-669f337bee2f" status: 200 len: 1304 microversion: 2.1 time: 0.197298 Jul 05 20:56:31.090653 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 136/261] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:56:30 2022] GET /compute/v2.1/servers/c6c3c1ea-31e8-4c65-b73d-669f337bee2f => generated 1304 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 20:56:31.180543 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-2fd849a0-f828-48d3-9f02-6fe0c0781977 tempest-VolumesActionsTest-1665182479 tempest-VolumesActionsTest-1665182479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd273630a84d41f49dcf8208c618f256', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a407f0bf436c4987b9eb2e59c46d82a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:56:31.189569 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-2fd849a0-f828-48d3-9f02-6fe0c0781977 tempest-VolumesActionsTest-1665182479 tempest-VolumesActionsTest-1665182479-project] 10.222.0.20 "GET /compute/v2.1/servers/41985a43-8b24-478a-8b18-c8559af076c9" status: 200 len: 1314 microversion: 2.1 time: 0.254380 Jul 05 20:56:31.194571 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 126/262] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:56:30 2022] GET /compute/v2.1/servers/41985a43-8b24-478a-8b18-c8559af076c9 => generated 1314 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 20:56:31.648194 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-bbd88cb9-b0d0-4dc6-be46-fa05a6acb329 tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:56:31.648748 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-bbd88cb9-b0d0-4dc6-be46-fa05a6acb329 tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] [instance: 7b18289e-137f-467c-96ec-cc6179f93e17] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:56:31.660679 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-bbd88cb9-b0d0-4dc6-be46-fa05a6acb329 tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:56:31.661158 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-bbd88cb9-b0d0-4dc6-be46-fa05a6acb329 tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:56:31.664154 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-bbd88cb9-b0d0-4dc6-be46-fa05a6acb329 tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:56:31.664816 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-bbd88cb9-b0d0-4dc6-be46-fa05a6acb329 tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:56:31.684490 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-67afbdd6-1246-4aa0-9810-87cd8267dfcd tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:56:31.686673 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-67afbdd6-1246-4aa0-9810-87cd8267dfcd tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] [instance: 52848078-62a1-484f-813c-7b3352cb3851] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:56:31.693791 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-67afbdd6-1246-4aa0-9810-87cd8267dfcd tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:56:31.694511 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-67afbdd6-1246-4aa0-9810-87cd8267dfcd tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:56:31.695279 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-67afbdd6-1246-4aa0-9810-87cd8267dfcd tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:56:31.695702 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-67afbdd6-1246-4aa0-9810-87cd8267dfcd tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:56:31.980457 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-bbd88cb9-b0d0-4dc6-be46-fa05a6acb329 tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a4b471d14044069a5969e8bc6ca4f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3429e99ac2a94266b152e053bc6a0006', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:56:31.993211 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-bbd88cb9-b0d0-4dc6-be46-fa05a6acb329 tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] 10.222.0.20 "GET /compute/v2.1/servers/7b18289e-137f-467c-96ec-cc6179f93e17" status: 200 len: 1270 microversion: 2.1 time: 0.349918 Jul 05 20:56:31.994617 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 137/263] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:56:31 2022] GET /compute/v2.1/servers/7b18289e-137f-467c-96ec-cc6179f93e17 => generated 1270 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 20:56:32.006037 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-67afbdd6-1246-4aa0-9810-87cd8267dfcd tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:56:32.017882 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-67afbdd6-1246-4aa0-9810-87cd8267dfcd tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:56:32.037231 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-67afbdd6-1246-4aa0-9810-87cd8267dfcd tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:56:32.039212 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-67afbdd6-1246-4aa0-9810-87cd8267dfcd tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] 10.222.0.20 "GET /compute/v2.1/servers/52848078-62a1-484f-813c-7b3352cb3851" status: 200 len: 1719 microversion: 2.20 time: 0.358573 Jul 05 20:56:32.039907 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 127/264] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 5 20:56:31 2022] GET /compute/v2.1/servers/52848078-62a1-484f-813c-7b3352cb3851 => generated 1719 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 05 20:56:32.113294 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-1c9c3dc3-ae85-4bc6-b671-055e63c44b30 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:56:32.114226 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-1c9c3dc3-ae85-4bc6-b671-055e63c44b30 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] [instance: c6c3c1ea-31e8-4c65-b73d-669f337bee2f] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:56:32.127471 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-1c9c3dc3-ae85-4bc6-b671-055e63c44b30 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:56:32.128463 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-1c9c3dc3-ae85-4bc6-b671-055e63c44b30 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:56:32.130615 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-1c9c3dc3-ae85-4bc6-b671-055e63c44b30 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:56:32.131737 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-1c9c3dc3-ae85-4bc6-b671-055e63c44b30 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:56:32.210021 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-2d0b7dc7-5aed-43cf-83e1-e021197209f9 tempest-VolumesActionsTest-1665182479 tempest-VolumesActionsTest-1665182479-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:56:32.210854 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-2d0b7dc7-5aed-43cf-83e1-e021197209f9 tempest-VolumesActionsTest-1665182479 tempest-VolumesActionsTest-1665182479-project] [instance: 41985a43-8b24-478a-8b18-c8559af076c9] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:56:32.220800 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-2d0b7dc7-5aed-43cf-83e1-e021197209f9 tempest-VolumesActionsTest-1665182479 tempest-VolumesActionsTest-1665182479-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:56:32.221567 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-2d0b7dc7-5aed-43cf-83e1-e021197209f9 tempest-VolumesActionsTest-1665182479 tempest-VolumesActionsTest-1665182479-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:56:32.222993 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-2d0b7dc7-5aed-43cf-83e1-e021197209f9 tempest-VolumesActionsTest-1665182479 tempest-VolumesActionsTest-1665182479-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:56:32.223757 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-2d0b7dc7-5aed-43cf-83e1-e021197209f9 tempest-VolumesActionsTest-1665182479 tempest-VolumesActionsTest-1665182479-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:56:32.252674 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-1c9c3dc3-ae85-4bc6-b671-055e63c44b30 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd152763a64794301b21587ab2b395bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc6d47f96d17471d94367bc8f8a3e3f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:56:32.262592 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-1c9c3dc3-ae85-4bc6-b671-055e63c44b30 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] 10.222.0.20 "GET /compute/v2.1/servers/c6c3c1ea-31e8-4c65-b73d-669f337bee2f" status: 200 len: 1302 microversion: 2.1 time: 0.154534 Jul 05 20:56:32.263559 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 138/265] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:56:32 2022] GET /compute/v2.1/servers/c6c3c1ea-31e8-4c65-b73d-669f337bee2f => generated 1302 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 20:56:32.517982 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-2d0b7dc7-5aed-43cf-83e1-e021197209f9 tempest-VolumesActionsTest-1665182479 tempest-VolumesActionsTest-1665182479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd273630a84d41f49dcf8208c618f256', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a407f0bf436c4987b9eb2e59c46d82a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:56:32.537045 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-2d0b7dc7-5aed-43cf-83e1-e021197209f9 tempest-VolumesActionsTest-1665182479 tempest-VolumesActionsTest-1665182479-project] 10.222.0.20 "GET /compute/v2.1/servers/41985a43-8b24-478a-8b18-c8559af076c9" status: 200 len: 1498 microversion: 2.1 time: 0.332332 Jul 05 20:56:32.537899 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 128/266] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:56:32 2022] GET /compute/v2.1/servers/41985a43-8b24-478a-8b18-c8559af076c9 => generated 1498 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 20:56:33.014507 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-c6c51833-965c-46ee-a8de-46b6efb94130 tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:56:33.017299 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-c6c51833-965c-46ee-a8de-46b6efb94130 tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] [instance: 7b18289e-137f-467c-96ec-cc6179f93e17] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:56:33.028787 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-c6c51833-965c-46ee-a8de-46b6efb94130 tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:56:33.029691 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-c6c51833-965c-46ee-a8de-46b6efb94130 tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:56:33.031081 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-c6c51833-965c-46ee-a8de-46b6efb94130 tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:56:33.031892 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-c6c51833-965c-46ee-a8de-46b6efb94130 tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:56:33.059248 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-8a965f68-696f-4456-8b53-d2a048ba5e21 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:56:33.060592 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-8a965f68-696f-4456-8b53-d2a048ba5e21 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] [instance: 52848078-62a1-484f-813c-7b3352cb3851] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:56:33.071684 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-8a965f68-696f-4456-8b53-d2a048ba5e21 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:56:33.078238 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-8a965f68-696f-4456-8b53-d2a048ba5e21 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:56:33.080271 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-8a965f68-696f-4456-8b53-d2a048ba5e21 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:56:33.081587 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-8a965f68-696f-4456-8b53-d2a048ba5e21 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:56:33.082434 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG dbcounter [-] [117628] Writing DB stats nova_cell0:SELECT=2 {{(pid=117628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:56:33.094226 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG dbcounter [-] [117628] Writing DB stats nova_cell0:SELECT=8 {{(pid=117628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:56:33.651828 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-c6c51833-965c-46ee-a8de-46b6efb94130 tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a4b471d14044069a5969e8bc6ca4f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3429e99ac2a94266b152e053bc6a0006', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:56:33.668224 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-8a965f68-696f-4456-8b53-d2a048ba5e21 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:56:33.672781 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-c6c51833-965c-46ee-a8de-46b6efb94130 tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] 10.222.0.20 "GET /compute/v2.1/servers/7b18289e-137f-467c-96ec-cc6179f93e17" status: 200 len: 1270 microversion: 2.1 time: 0.655079 Jul 05 20:56:33.686294 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 139/267] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:56:33 2022] GET /compute/v2.1/servers/7b18289e-137f-467c-96ec-cc6179f93e17 => generated 1270 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 20:56:33.691776 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-e9239fdd-0745-44fa-aa95-f4c9b381c5e2 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:56:33.706035 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-8a965f68-696f-4456-8b53-d2a048ba5e21 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:56:33.707545 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-8a965f68-696f-4456-8b53-d2a048ba5e21 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:56:33.708912 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-8a965f68-696f-4456-8b53-d2a048ba5e21 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] 10.222.0.20 "GET /compute/v2.1/servers/52848078-62a1-484f-813c-7b3352cb3851" status: 200 len: 1719 microversion: 2.20 time: 0.654545 Jul 05 20:56:33.711089 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-e9239fdd-0745-44fa-aa95-f4c9b381c5e2 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] [instance: c6c3c1ea-31e8-4c65-b73d-669f337bee2f] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:56:33.716210 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 129/268] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 5 20:56:33 2022] GET /compute/v2.1/servers/52848078-62a1-484f-813c-7b3352cb3851 => generated 1719 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 05 20:56:33.745460 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-e9239fdd-0745-44fa-aa95-f4c9b381c5e2 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:56:33.747249 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-e9239fdd-0745-44fa-aa95-f4c9b381c5e2 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:56:33.750904 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-e9239fdd-0745-44fa-aa95-f4c9b381c5e2 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:56:33.752339 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-e9239fdd-0745-44fa-aa95-f4c9b381c5e2 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:56:33.773391 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-5ac582f2-e1b0-4ed5-87f4-44f517516c6f tempest-VolumesActionsTest-1665182479 tempest-VolumesActionsTest-1665182479-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:56:33.774026 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-5ac582f2-e1b0-4ed5-87f4-44f517516c6f tempest-VolumesActionsTest-1665182479 tempest-VolumesActionsTest-1665182479-project] [instance: 41985a43-8b24-478a-8b18-c8559af076c9] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:56:33.796578 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-5ac582f2-e1b0-4ed5-87f4-44f517516c6f tempest-VolumesActionsTest-1665182479 tempest-VolumesActionsTest-1665182479-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:56:33.797510 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-5ac582f2-e1b0-4ed5-87f4-44f517516c6f tempest-VolumesActionsTest-1665182479 tempest-VolumesActionsTest-1665182479-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:56:33.798433 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-5ac582f2-e1b0-4ed5-87f4-44f517516c6f tempest-VolumesActionsTest-1665182479 tempest-VolumesActionsTest-1665182479-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:56:33.799711 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-5ac582f2-e1b0-4ed5-87f4-44f517516c6f tempest-VolumesActionsTest-1665182479 tempest-VolumesActionsTest-1665182479-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:56:33.874820 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-5ac582f2-e1b0-4ed5-87f4-44f517516c6f tempest-VolumesActionsTest-1665182479 tempest-VolumesActionsTest-1665182479-project] [instance: 41985a43-8b24-478a-8b18-c8559af076c9] Going to try to terminate instance {{(pid=117627) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 05 20:56:34.047806 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG dbcounter [-] [117627] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=117627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:56:34.066152 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-5ac582f2-e1b0-4ed5-87f4-44f517516c6f tempest-VolumesActionsTest-1665182479 tempest-VolumesActionsTest-1665182479-project] 10.222.0.20 "DELETE /compute/v2.1/servers/41985a43-8b24-478a-8b18-c8559af076c9" status: 204 len: 0 microversion: 2.1 time: 0.328539 Jul 05 20:56:34.067648 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 130/269] 10.222.0.20 () {58 vars in 1238 bytes} [Tue Jul 5 20:56:33 2022] DELETE /compute/v2.1/servers/41985a43-8b24-478a-8b18-c8559af076c9 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 05 20:56:34.076179 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-f556bfbd-410d-4b42-9782-49dedaeb7e97 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 20:56:34.084648 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-f556bfbd-410d-4b42-9782-49dedaeb7e97 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:56:34.086131 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-f556bfbd-410d-4b42-9782-49dedaeb7e97 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:56:34.196164 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-f556bfbd-410d-4b42-9782-49dedaeb7e97 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] [instance: f236112c-4649-478b-a626-b84f8ff1bfe9] Going to try to stop instance {{(pid=117627) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 05 20:56:34.327112 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-e9239fdd-0745-44fa-aa95-f4c9b381c5e2 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd152763a64794301b21587ab2b395bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc6d47f96d17471d94367bc8f8a3e3f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:56:34.340209 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-e9239fdd-0745-44fa-aa95-f4c9b381c5e2 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] 10.222.0.20 "GET /compute/v2.1/servers/c6c3c1ea-31e8-4c65-b73d-669f337bee2f" status: 200 len: 1370 microversion: 2.1 time: 0.652250 Jul 05 20:56:34.341097 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 140/270] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:56:33 2022] GET /compute/v2.1/servers/c6c3c1ea-31e8-4c65-b73d-669f337bee2f => generated 1370 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 20:56:34.354997 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-2c85ddb4-a47a-4740-ac53-e9286ed36935 tempest-VolumesActionsTest-1665182479 tempest-VolumesActionsTest-1665182479-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:56:34.355762 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-2c85ddb4-a47a-4740-ac53-e9286ed36935 tempest-VolumesActionsTest-1665182479 tempest-VolumesActionsTest-1665182479-project] [instance: 41985a43-8b24-478a-8b18-c8559af076c9] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:56:34.362755 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-2c85ddb4-a47a-4740-ac53-e9286ed36935 tempest-VolumesActionsTest-1665182479 tempest-VolumesActionsTest-1665182479-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:56:34.363496 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-2c85ddb4-a47a-4740-ac53-e9286ed36935 tempest-VolumesActionsTest-1665182479 tempest-VolumesActionsTest-1665182479-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:56:34.364753 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-2c85ddb4-a47a-4740-ac53-e9286ed36935 tempest-VolumesActionsTest-1665182479 tempest-VolumesActionsTest-1665182479-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:56:34.367635 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-2c85ddb4-a47a-4740-ac53-e9286ed36935 tempest-VolumesActionsTest-1665182479 tempest-VolumesActionsTest-1665182479-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:56:34.557613 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-f556bfbd-410d-4b42-9782-49dedaeb7e97 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] 10.222.0.20 "POST /compute/v2.1/servers/f236112c-4649-478b-a626-b84f8ff1bfe9/action" status: 202 len: 0 microversion: 2.1 time: 0.488129 Jul 05 20:56:34.566552 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 131/271] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Jul 5 20:56:34 2022] POST /compute/v2.1/servers/f236112c-4649-478b-a626-b84f8ff1bfe9/action => generated 0 bytes in 498 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 05 20:56:34.580503 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-2788fe64-4d93-4872-94b9-b0257de7c192 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:56:34.581595 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-2788fe64-4d93-4872-94b9-b0257de7c192 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] [instance: f236112c-4649-478b-a626-b84f8ff1bfe9] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:56:34.590527 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-2788fe64-4d93-4872-94b9-b0257de7c192 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:56:34.591374 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-2788fe64-4d93-4872-94b9-b0257de7c192 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:56:34.592394 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-2788fe64-4d93-4872-94b9-b0257de7c192 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:56:34.593588 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-2788fe64-4d93-4872-94b9-b0257de7c192 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:56:35.064019 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-2c85ddb4-a47a-4740-ac53-e9286ed36935 tempest-VolumesActionsTest-1665182479 tempest-VolumesActionsTest-1665182479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd273630a84d41f49dcf8208c618f256', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a407f0bf436c4987b9eb2e59c46d82a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:56:35.075891 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-2c85ddb4-a47a-4740-ac53-e9286ed36935 tempest-VolumesActionsTest-1665182479 tempest-VolumesActionsTest-1665182479-project] 10.222.0.20 "GET /compute/v2.1/servers/41985a43-8b24-478a-8b18-c8559af076c9" status: 200 len: 1504 microversion: 2.1 time: 0.733471 Jul 05 20:56:35.076501 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 141/272] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:56:34 2022] GET /compute/v2.1/servers/41985a43-8b24-478a-8b18-c8559af076c9 => generated 1504 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 20:56:35.082450 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-1f4f9c6a-3f2b-48a8-9196-fce99c032a8c tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:56:35.097120 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-1f4f9c6a-3f2b-48a8-9196-fce99c032a8c tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] [instance: 7b18289e-137f-467c-96ec-cc6179f93e17] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:56:35.111048 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-1f4f9c6a-3f2b-48a8-9196-fce99c032a8c tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:56:35.113836 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-1f4f9c6a-3f2b-48a8-9196-fce99c032a8c tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:56:35.114705 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-1f4f9c6a-3f2b-48a8-9196-fce99c032a8c tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:56:35.115146 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-1f4f9c6a-3f2b-48a8-9196-fce99c032a8c tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:56:35.129938 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-2788fe64-4d93-4872-94b9-b0257de7c192 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eac41ce3f04450b840cff305ec1a5ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47e1ad014d542f98f6b24c8a504d166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:56:35.143293 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-2788fe64-4d93-4872-94b9-b0257de7c192 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] 10.222.0.20 "GET /compute/v2.1/servers/f236112c-4649-478b-a626-b84f8ff1bfe9" status: 200 len: 1722 microversion: 2.1 time: 0.572924 Jul 05 20:56:35.154854 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 132/273] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:56:34 2022] GET /compute/v2.1/servers/f236112c-4649-478b-a626-b84f8ff1bfe9 => generated 1722 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 20:56:35.161945 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-da8fb9b8-5f99-4558-90fc-644797f21f52 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:56:35.163984 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-da8fb9b8-5f99-4558-90fc-644797f21f52 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] [instance: 52848078-62a1-484f-813c-7b3352cb3851] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:56:35.174787 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-da8fb9b8-5f99-4558-90fc-644797f21f52 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:56:35.175544 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-da8fb9b8-5f99-4558-90fc-644797f21f52 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:56:35.176396 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-da8fb9b8-5f99-4558-90fc-644797f21f52 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:56:35.176896 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-da8fb9b8-5f99-4558-90fc-644797f21f52 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:56:35.339039 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-1f4f9c6a-3f2b-48a8-9196-fce99c032a8c tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a4b471d14044069a5969e8bc6ca4f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3429e99ac2a94266b152e053bc6a0006', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:56:35.366193 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-1f4f9c6a-3f2b-48a8-9196-fce99c032a8c tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] 10.222.0.20 "GET /compute/v2.1/servers/7b18289e-137f-467c-96ec-cc6179f93e17" status: 200 len: 1258 microversion: 2.1 time: 0.285328 Jul 05 20:56:35.367865 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 142/274] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:56:35 2022] GET /compute/v2.1/servers/7b18289e-137f-467c-96ec-cc6179f93e17 => generated 1258 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 20:56:35.382881 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-fa9f95b0-e994-40c1-a1e6-ec72a49a35e1 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:56:35.383915 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-fa9f95b0-e994-40c1-a1e6-ec72a49a35e1 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] [instance: c6c3c1ea-31e8-4c65-b73d-669f337bee2f] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:56:35.393123 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-fa9f95b0-e994-40c1-a1e6-ec72a49a35e1 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:56:35.395286 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-fa9f95b0-e994-40c1-a1e6-ec72a49a35e1 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:56:35.396251 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-fa9f95b0-e994-40c1-a1e6-ec72a49a35e1 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:56:35.397396 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-fa9f95b0-e994-40c1-a1e6-ec72a49a35e1 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:56:35.421634 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-da8fb9b8-5f99-4558-90fc-644797f21f52 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:56:35.431813 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-da8fb9b8-5f99-4558-90fc-644797f21f52 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:56:35.433531 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-da8fb9b8-5f99-4558-90fc-644797f21f52 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:56:35.434941 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-da8fb9b8-5f99-4558-90fc-644797f21f52 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] 10.222.0.20 "GET /compute/v2.1/servers/52848078-62a1-484f-813c-7b3352cb3851" status: 200 len: 1719 microversion: 2.20 time: 0.277278 Jul 05 20:56:35.435993 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 133/275] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 5 20:56:35 2022] GET /compute/v2.1/servers/52848078-62a1-484f-813c-7b3352cb3851 => generated 1719 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 20:56:35.557961 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-fa9f95b0-e994-40c1-a1e6-ec72a49a35e1 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd152763a64794301b21587ab2b395bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc6d47f96d17471d94367bc8f8a3e3f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:56:35.568301 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-fa9f95b0-e994-40c1-a1e6-ec72a49a35e1 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] 10.222.0.20 "GET /compute/v2.1/servers/c6c3c1ea-31e8-4c65-b73d-669f337bee2f" status: 200 len: 1370 microversion: 2.1 time: 0.198264 Jul 05 20:56:35.570085 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 143/276] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:56:35 2022] GET /compute/v2.1/servers/c6c3c1ea-31e8-4c65-b73d-669f337bee2f => generated 1370 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 20:56:36.094905 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-f5811e80-b099-4ba5-9186-88ad5c48ba66 tempest-VolumesActionsTest-1665182479 tempest-VolumesActionsTest-1665182479-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:56:36.095609 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-f5811e80-b099-4ba5-9186-88ad5c48ba66 tempest-VolumesActionsTest-1665182479 tempest-VolumesActionsTest-1665182479-project] [instance: 41985a43-8b24-478a-8b18-c8559af076c9] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:56:36.107216 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-f5811e80-b099-4ba5-9186-88ad5c48ba66 tempest-VolumesActionsTest-1665182479 tempest-VolumesActionsTest-1665182479-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:56:36.109416 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-f5811e80-b099-4ba5-9186-88ad5c48ba66 tempest-VolumesActionsTest-1665182479 tempest-VolumesActionsTest-1665182479-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:56:36.112602 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-f5811e80-b099-4ba5-9186-88ad5c48ba66 tempest-VolumesActionsTest-1665182479 tempest-VolumesActionsTest-1665182479-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:56:36.113317 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-f5811e80-b099-4ba5-9186-88ad5c48ba66 tempest-VolumesActionsTest-1665182479 tempest-VolumesActionsTest-1665182479-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:56:36.163476 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-736d1118-2b86-4817-a929-96ec98138b5b tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:56:36.164526 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-736d1118-2b86-4817-a929-96ec98138b5b tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] [instance: f236112c-4649-478b-a626-b84f8ff1bfe9] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:56:36.188746 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-736d1118-2b86-4817-a929-96ec98138b5b tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:56:36.189230 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-736d1118-2b86-4817-a929-96ec98138b5b tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:56:36.190006 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-736d1118-2b86-4817-a929-96ec98138b5b tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:56:36.190434 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-736d1118-2b86-4817-a929-96ec98138b5b tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:56:36.852807 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-736d1118-2b86-4817-a929-96ec98138b5b tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eac41ce3f04450b840cff305ec1a5ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47e1ad014d542f98f6b24c8a504d166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:56:36.875981 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-736d1118-2b86-4817-a929-96ec98138b5b tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] 10.222.0.20 "GET /compute/v2.1/servers/f236112c-4649-478b-a626-b84f8ff1bfe9" status: 200 len: 1722 microversion: 2.1 time: 0.706435 Jul 05 20:56:36.877032 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 144/277] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:56:36 2022] GET /compute/v2.1/servers/f236112c-4649-478b-a626-b84f8ff1bfe9 => generated 1722 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 20:56:36.884636 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-2a2f57fc-a312-48d4-8141-8726d6aecf1e tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:56:36.888736 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-f5811e80-b099-4ba5-9186-88ad5c48ba66 tempest-VolumesActionsTest-1665182479 tempest-VolumesActionsTest-1665182479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd273630a84d41f49dcf8208c618f256', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a407f0bf436c4987b9eb2e59c46d82a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:56:36.898885 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-f5811e80-b099-4ba5-9186-88ad5c48ba66 tempest-VolumesActionsTest-1665182479 tempest-VolumesActionsTest-1665182479-project] 10.222.0.20 "GET /compute/v2.1/servers/41985a43-8b24-478a-8b18-c8559af076c9" status: 200 len: 1504 microversion: 2.1 time: 0.808737 Jul 05 20:56:36.904471 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-2a2f57fc-a312-48d4-8141-8726d6aecf1e tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] [instance: 7b18289e-137f-467c-96ec-cc6179f93e17] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:56:36.924704 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 134/278] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:56:36 2022] GET /compute/v2.1/servers/41985a43-8b24-478a-8b18-c8559af076c9 => generated 1504 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 20:56:36.938939 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-2a2f57fc-a312-48d4-8141-8726d6aecf1e tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:56:36.939390 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-2a2f57fc-a312-48d4-8141-8726d6aecf1e tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:56:36.939574 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-91ca9844-b2d2-40f8-8488-d3b9c1eb7fc7 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:56:36.940527 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-91ca9844-b2d2-40f8-8488-d3b9c1eb7fc7 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] [instance: 52848078-62a1-484f-813c-7b3352cb3851] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:56:36.945450 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-2a2f57fc-a312-48d4-8141-8726d6aecf1e tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:56:36.947927 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-2a2f57fc-a312-48d4-8141-8726d6aecf1e tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:56:36.961350 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-91ca9844-b2d2-40f8-8488-d3b9c1eb7fc7 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:56:36.981057 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-91ca9844-b2d2-40f8-8488-d3b9c1eb7fc7 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:56:36.983952 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-91ca9844-b2d2-40f8-8488-d3b9c1eb7fc7 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:56:36.984647 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-91ca9844-b2d2-40f8-8488-d3b9c1eb7fc7 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:56:37.333919 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-2a2f57fc-a312-48d4-8141-8726d6aecf1e tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a4b471d14044069a5969e8bc6ca4f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3429e99ac2a94266b152e053bc6a0006', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:56:37.345431 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-2a2f57fc-a312-48d4-8141-8726d6aecf1e tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] 10.222.0.20 "GET /compute/v2.1/servers/7b18289e-137f-467c-96ec-cc6179f93e17" status: 200 len: 1258 microversion: 2.1 time: 0.467114 Jul 05 20:56:37.349611 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 145/279] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:56:36 2022] GET /compute/v2.1/servers/7b18289e-137f-467c-96ec-cc6179f93e17 => generated 1258 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 20:56:37.364726 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-6fe21d71-3f35-4527-aaee-3b3749992c4d tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:56:37.365371 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-6fe21d71-3f35-4527-aaee-3b3749992c4d tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] [instance: c6c3c1ea-31e8-4c65-b73d-669f337bee2f] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:56:37.380639 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-6fe21d71-3f35-4527-aaee-3b3749992c4d tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:56:37.381123 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-6fe21d71-3f35-4527-aaee-3b3749992c4d tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:56:37.381921 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-6fe21d71-3f35-4527-aaee-3b3749992c4d tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:56:37.382362 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-6fe21d71-3f35-4527-aaee-3b3749992c4d tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:56:37.426439 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-91ca9844-b2d2-40f8-8488-d3b9c1eb7fc7 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:56:37.435512 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-91ca9844-b2d2-40f8-8488-d3b9c1eb7fc7 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:56:37.445428 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-91ca9844-b2d2-40f8-8488-d3b9c1eb7fc7 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:56:37.447073 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-91ca9844-b2d2-40f8-8488-d3b9c1eb7fc7 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] 10.222.0.20 "GET /compute/v2.1/servers/52848078-62a1-484f-813c-7b3352cb3851" status: 200 len: 1719 microversion: 2.20 time: 0.520963 Jul 05 20:56:37.449227 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 135/280] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 5 20:56:36 2022] GET /compute/v2.1/servers/52848078-62a1-484f-813c-7b3352cb3851 => generated 1719 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 20:56:37.456014 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [req-d1488f62-8827-43af-b484-0608b147dc12 req-4173c064-3495-4313-8086-623f5161baf9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41985a43-8b24-478a-8b18-c8559af076c9", "name": "network-vif-deleted", "tag": "776baae1-5f4b-45c1-b0d2-5591f34aba38"}]} {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 20:56:37.485749 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [req-d1488f62-8827-43af-b484-0608b147dc12 req-4173c064-3495-4313-8086-623f5161baf9 service nova] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:56:37.487571 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [req-d1488f62-8827-43af-b484-0608b147dc12 req-4173c064-3495-4313-8086-623f5161baf9 service nova] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:56:37.505375 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.compute.server_external_events [req-d1488f62-8827-43af-b484-0608b147dc12 req-4173c064-3495-4313-8086-623f5161baf9 service nova] Creating event network-vif-deleted:776baae1-5f4b-45c1-b0d2-5591f34aba38 for instance 41985a43-8b24-478a-8b18-c8559af076c9 on hv-cinder-79760 Jul 05 20:56:37.511369 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [req-d1488f62-8827-43af-b484-0608b147dc12 req-4173c064-3495-4313-8086-623f5161baf9 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060809 Jul 05 20:56:37.512758 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 136/281] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 5 20:56:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 20:56:37.599043 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [req-91e580c0-dd69-45d1-af72-d5f080d07285 req-86812db1-5095-4151-92e9-db2b3f39c81c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c6c3c1ea-31e8-4c65-b73d-669f337bee2f", "tag": "895e5d50-4373-406a-8f11-70a9e025443e"}]} {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 20:56:37.608984 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [req-91e580c0-dd69-45d1-af72-d5f080d07285 req-86812db1-5095-4151-92e9-db2b3f39c81c service nova] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:56:37.610216 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [req-91e580c0-dd69-45d1-af72-d5f080d07285 req-86812db1-5095-4151-92e9-db2b3f39c81c service nova] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:56:37.622940 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.compute.server_external_events [req-91e580c0-dd69-45d1-af72-d5f080d07285 req-86812db1-5095-4151-92e9-db2b3f39c81c service nova] Creating event network-changed:895e5d50-4373-406a-8f11-70a9e025443e for instance c6c3c1ea-31e8-4c65-b73d-669f337bee2f on hv-cinder-79760 Jul 05 20:56:37.630382 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [req-91e580c0-dd69-45d1-af72-d5f080d07285 req-86812db1-5095-4151-92e9-db2b3f39c81c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035898 Jul 05 20:56:37.638182 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 137/282] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 5 20:56:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 05 20:56:37.729921 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-6fe21d71-3f35-4527-aaee-3b3749992c4d tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd152763a64794301b21587ab2b395bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc6d47f96d17471d94367bc8f8a3e3f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:56:37.739026 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-6fe21d71-3f35-4527-aaee-3b3749992c4d tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] 10.222.0.20 "GET /compute/v2.1/servers/c6c3c1ea-31e8-4c65-b73d-669f337bee2f" status: 200 len: 1370 microversion: 2.1 time: 0.387700 Jul 05 20:56:37.739942 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 146/283] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:56:37 2022] GET /compute/v2.1/servers/c6c3c1ea-31e8-4c65-b73d-669f337bee2f => generated 1370 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 20:56:37.895181 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-d5a71387-fd9b-4bcb-9bd2-129045afff1e tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:56:37.900303 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-d5a71387-fd9b-4bcb-9bd2-129045afff1e tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] [instance: f236112c-4649-478b-a626-b84f8ff1bfe9] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:56:37.909526 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-d5a71387-fd9b-4bcb-9bd2-129045afff1e tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:56:37.909979 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-d5a71387-fd9b-4bcb-9bd2-129045afff1e tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:56:37.910763 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-d5a71387-fd9b-4bcb-9bd2-129045afff1e tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:56:37.911198 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-d5a71387-fd9b-4bcb-9bd2-129045afff1e tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:56:37.929658 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-32270db1-453b-43de-958f-6b1058ec95d6 tempest-VolumesActionsTest-1665182479 tempest-VolumesActionsTest-1665182479-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:56:37.931327 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-32270db1-453b-43de-958f-6b1058ec95d6 tempest-VolumesActionsTest-1665182479 tempest-VolumesActionsTest-1665182479-project] [instance: 41985a43-8b24-478a-8b18-c8559af076c9] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:56:37.942526 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-32270db1-453b-43de-958f-6b1058ec95d6 tempest-VolumesActionsTest-1665182479 tempest-VolumesActionsTest-1665182479-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:56:37.942975 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-32270db1-453b-43de-958f-6b1058ec95d6 tempest-VolumesActionsTest-1665182479 tempest-VolumesActionsTest-1665182479-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:56:37.943742 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-32270db1-453b-43de-958f-6b1058ec95d6 tempest-VolumesActionsTest-1665182479 tempest-VolumesActionsTest-1665182479-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:56:37.944171 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-32270db1-453b-43de-958f-6b1058ec95d6 tempest-VolumesActionsTest-1665182479 tempest-VolumesActionsTest-1665182479-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:56:38.025732 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-32270db1-453b-43de-958f-6b1058ec95d6 tempest-VolumesActionsTest-1665182479 tempest-VolumesActionsTest-1665182479-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:56:38.026182 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-32270db1-453b-43de-958f-6b1058ec95d6 tempest-VolumesActionsTest-1665182479 tempest-VolumesActionsTest-1665182479-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:56:38.026629 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.objects.instance [None req-32270db1-453b-43de-958f-6b1058ec95d6 tempest-VolumesActionsTest-1665182479 tempest-VolumesActionsTest-1665182479-project] Lazy-loading 'fault' on Instance uuid 41985a43-8b24-478a-8b18-c8559af076c9 {{(pid=117628) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 05 20:56:38.132657 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-32270db1-453b-43de-958f-6b1058ec95d6 tempest-VolumesActionsTest-1665182479 tempest-VolumesActionsTest-1665182479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd273630a84d41f49dcf8208c618f256', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a407f0bf436c4987b9eb2e59c46d82a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:56:38.142945 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-32270db1-453b-43de-958f-6b1058ec95d6 tempest-VolumesActionsTest-1665182479 tempest-VolumesActionsTest-1665182479-project] 10.222.0.20 "GET /compute/v2.1/servers/41985a43-8b24-478a-8b18-c8559af076c9" status: 200 len: 1304 microversion: 2.1 time: 0.217203 Jul 05 20:56:38.143552 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 147/284] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:56:37 2022] GET /compute/v2.1/servers/41985a43-8b24-478a-8b18-c8559af076c9 => generated 1304 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 20:56:38.218592 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-d5a71387-fd9b-4bcb-9bd2-129045afff1e tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eac41ce3f04450b840cff305ec1a5ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47e1ad014d542f98f6b24c8a504d166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:56:38.222024 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG dbcounter [-] [117627] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:56:38.239434 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-d5a71387-fd9b-4bcb-9bd2-129045afff1e tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] 10.222.0.20 "GET /compute/v2.1/servers/f236112c-4649-478b-a626-b84f8ff1bfe9" status: 200 len: 1722 microversion: 2.1 time: 0.348699 Jul 05 20:56:38.240670 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 138/285] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:56:37 2022] GET /compute/v2.1/servers/f236112c-4649-478b-a626-b84f8ff1bfe9 => generated 1722 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 20:56:38.365714 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-cc483bc2-6535-40d3-b423-4e3ac65de842 tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:56:38.366334 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-cc483bc2-6535-40d3-b423-4e3ac65de842 tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] [instance: 7b18289e-137f-467c-96ec-cc6179f93e17] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:56:38.368916 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG dbcounter [-] [117627] Writing DB stats nova_cell0:SELECT=2 {{(pid=117627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:56:38.375239 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-cc483bc2-6535-40d3-b423-4e3ac65de842 tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:56:38.376171 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-cc483bc2-6535-40d3-b423-4e3ac65de842 tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:56:38.377342 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-cc483bc2-6535-40d3-b423-4e3ac65de842 tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:56:38.377983 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-cc483bc2-6535-40d3-b423-4e3ac65de842 tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:56:38.659000 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-98831e7c-b051-4eff-8fe4-1a5bc2bee4e4 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Action: 'create', calling method: .version_select at 0x7f57cf3e48b0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-858447728", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCueV7/0l9pirmiQ1UXTkl1bdf3T8xlxrib6VkDUiOq0QZLbq4OsWztRof3JGujyzybf9LSW/VHUcYuMme/TgEXd4GO6pJFzTb0PLmwXlN6gI0IxsfRw79OjeKsGr4cEDw=="}} {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 20:56:38.678978 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG dbcounter [-] [117627] Writing DB stats nova_cell0:SELECT=20 {{(pid=117627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:56:38.679609 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.quota [None req-98831e7c-b051-4eff-8fe4-1a5bc2bee4e4 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Getting quotas for project 6c9a3d56f8b84eb2a057425afbf79079. Resources: {'key_pairs'} {{(pid=117628) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 05 20:56:38.684508 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.quota [None req-98831e7c-b051-4eff-8fe4-1a5bc2bee4e4 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Getting quotas for user 261feb03a8ff459b8874232bec05034f and project 6c9a3d56f8b84eb2a057425afbf79079. Resources: {'key_pairs'} {{(pid=117628) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 05 20:56:38.715094 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-98831e7c-b051-4eff-8fe4-1a5bc2bee4e4 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.384056 Jul 05 20:56:38.720307 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 148/286] 10.222.0.20 () {60 vars in 1158 bytes} [Tue Jul 5 20:56:38 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 05 20:56:38.727939 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-b6c9ece9-481b-4835-aad3-bd23e47ad3a6 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:56:38.728860 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-b6c9ece9-481b-4835-aad3-bd23e47ad3a6 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] [instance: 52848078-62a1-484f-813c-7b3352cb3851] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:56:38.730173 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-cc483bc2-6535-40d3-b423-4e3ac65de842 tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a4b471d14044069a5969e8bc6ca4f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3429e99ac2a94266b152e053bc6a0006', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:56:38.740923 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-cc483bc2-6535-40d3-b423-4e3ac65de842 tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] 10.222.0.20 "GET /compute/v2.1/servers/7b18289e-137f-467c-96ec-cc6179f93e17" status: 200 len: 1258 microversion: 2.1 time: 0.378999 Jul 05 20:56:38.742113 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 139/287] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:56:38 2022] GET /compute/v2.1/servers/7b18289e-137f-467c-96ec-cc6179f93e17 => generated 1258 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 20:56:38.760820 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-bc4ee12e-e8e0-406e-9436-0af668462134 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:56:38.761754 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-bc4ee12e-e8e0-406e-9436-0af668462134 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] [instance: c6c3c1ea-31e8-4c65-b73d-669f337bee2f] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:56:38.769652 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-b6c9ece9-481b-4835-aad3-bd23e47ad3a6 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:56:38.770322 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-b6c9ece9-481b-4835-aad3-bd23e47ad3a6 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:56:38.771321 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-b6c9ece9-481b-4835-aad3-bd23e47ad3a6 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:56:38.772532 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-b6c9ece9-481b-4835-aad3-bd23e47ad3a6 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:56:38.778446 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-bc4ee12e-e8e0-406e-9436-0af668462134 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:56:38.779191 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-bc4ee12e-e8e0-406e-9436-0af668462134 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:56:38.782171 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-bc4ee12e-e8e0-406e-9436-0af668462134 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:56:38.783227 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-bc4ee12e-e8e0-406e-9436-0af668462134 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:56:38.786740 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG dbcounter [-] [117628] Writing DB stats nova_cell1:INSERT=1,nova_cell1:SELECT=99 {{(pid=117628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:56:39.139977 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-bc4ee12e-e8e0-406e-9436-0af668462134 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd152763a64794301b21587ab2b395bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc6d47f96d17471d94367bc8f8a3e3f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:56:39.146846 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-b6c9ece9-481b-4835-aad3-bd23e47ad3a6 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:56:39.150803 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-bc4ee12e-e8e0-406e-9436-0af668462134 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] 10.222.0.20 "GET /compute/v2.1/servers/c6c3c1ea-31e8-4c65-b73d-669f337bee2f" status: 200 len: 1370 microversion: 2.1 time: 0.394986 Jul 05 20:56:39.152399 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 140/288] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:56:38 2022] GET /compute/v2.1/servers/c6c3c1ea-31e8-4c65-b73d-669f337bee2f => generated 1370 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 20:56:39.166148 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-b6c9ece9-481b-4835-aad3-bd23e47ad3a6 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:56:39.167976 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-b6c9ece9-481b-4835-aad3-bd23e47ad3a6 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:56:39.169186 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-b6c9ece9-481b-4835-aad3-bd23e47ad3a6 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] 10.222.0.20 "GET /compute/v2.1/servers/52848078-62a1-484f-813c-7b3352cb3851" status: 200 len: 1719 microversion: 2.20 time: 0.446872 Jul 05 20:56:39.169482 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-24c58b4b-267f-4a58-85bd-2fed227705db tempest-VolumesActionsTest-1665182479 tempest-VolumesActionsTest-1665182479-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:56:39.170232 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-24c58b4b-267f-4a58-85bd-2fed227705db tempest-VolumesActionsTest-1665182479 tempest-VolumesActionsTest-1665182479-project] [instance: 41985a43-8b24-478a-8b18-c8559af076c9] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:56:39.170396 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 149/289] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 5 20:56:38 2022] GET /compute/v2.1/servers/52848078-62a1-484f-813c-7b3352cb3851 => generated 1719 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 20:56:39.178344 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-24c58b4b-267f-4a58-85bd-2fed227705db tempest-VolumesActionsTest-1665182479 tempest-VolumesActionsTest-1665182479-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:56:39.178883 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-24c58b4b-267f-4a58-85bd-2fed227705db tempest-VolumesActionsTest-1665182479 tempest-VolumesActionsTest-1665182479-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:56:39.179912 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-24c58b4b-267f-4a58-85bd-2fed227705db tempest-VolumesActionsTest-1665182479 tempest-VolumesActionsTest-1665182479-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:56:39.180922 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-24c58b4b-267f-4a58-85bd-2fed227705db tempest-VolumesActionsTest-1665182479 tempest-VolumesActionsTest-1665182479-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:56:39.199991 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.wsgi [None req-24c58b4b-267f-4a58-85bd-2fed227705db tempest-VolumesActionsTest-1665182479 tempest-VolumesActionsTest-1665182479-project] HTTP exception thrown: Instance 41985a43-8b24-478a-8b18-c8559af076c9 could not be found. Jul 05 20:56:39.204373 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-24c58b4b-267f-4a58-85bd-2fed227705db tempest-VolumesActionsTest-1665182479 tempest-VolumesActionsTest-1665182479-project] Request method failure captured: Jul 05 20:56:39.204373 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: request: GET /compute/v2.1/servers/41985a43-8b24-478a-8b18-c8559af076c9 HTTP/1.1 Jul 05 20:56:39.204373 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: Accept: application/json Jul 05 20:56:39.204373 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: Accept-Encoding: identity Jul 05 20:56:39.204373 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: Connection: close Jul 05 20:56:39.204373 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: Content-Length: 0 Jul 05 20:56:39.204373 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: Content-Type: application/json Jul 05 20:56:39.204373 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: Host: 10.222.0.20 Jul 05 20:56:39.204373 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: Openstack-System-Scope: None Jul 05 20:56:39.204373 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: User-Agent: python-urllib3/1.26.9 Jul 05 20:56:39.204373 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Auth-Token: gAAAAABixKVtRDF5eIqaOGyYH9szJ7KylNJKpucEkzUHEXp3nLPmbhdCsO78AB8MKE8XGaRtgIfA68hULwS46lM9erEJqTeswfq6XF451cPAZIKjXbxO1admaTpuaMjdSCse8E0AzKvgLty-1JdLMvI2FUoQDkfYdnC7DfxBtwZiqS8Z0y1Aa_0 Jul 05 20:56:39.204373 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Domain-Id: None Jul 05 20:56:39.204373 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Domain-Name: None Jul 05 20:56:39.204373 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Identity-Status: Confirmed Jul 05 20:56:39.204373 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Is-Admin-Project: True Jul 05 20:56:39.204373 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Project-Domain-Id: default Jul 05 20:56:39.204373 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Project-Domain-Name: Default Jul 05 20:56:39.204373 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Project-Id: a407f0bf436c4987b9eb2e59c46d82a9 Jul 05 20:56:39.204373 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Project-Name: tempest-VolumesActionsTest-1665182479 Jul 05 20:56:39.204373 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Role: member,reader Jul 05 20:56:39.204373 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Roles: member,reader Jul 05 20:56:39.205904 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a407f0bf436c4987b9eb2e59c46d82a9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/a407f0bf436c4987b9eb2e59c46d82a9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_a407f0bf436c4987b9eb2e59c46d82a9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a407f0bf436c4987b9eb2e59c46d82a9"}]}] Jul 05 20:56:39.205904 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Tenant: tempest-VolumesActionsTest-1665182479 Jul 05 20:56:39.205904 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Tenant-Id: a407f0bf436c4987b9eb2e59c46d82a9 Jul 05 20:56:39.205904 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Tenant-Name: tempest-VolumesActionsTest-1665182479 Jul 05 20:56:39.205904 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-User: tempest-VolumesActionsTest-1665182479-project Jul 05 20:56:39.205904 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-User-Domain-Id: default Jul 05 20:56:39.205904 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-User-Domain-Name: Default Jul 05 20:56:39.205904 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-User-Id: fd273630a84d41f49dcf8208c618f256 Jul 05 20:56:39.205904 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-User-Name: tempest-VolumesActionsTest-1665182479-project Jul 05 20:56:39.205904 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: method: > Jul 05 20:56:39.205904 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: exception: Instance 41985a43-8b24-478a-8b18-c8559af076c9 could not be found. Jul 05 20:56:39.205904 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: action_args: {'id': '41985a43-8b24-478a-8b18-c8559af076c9'} Jul 05 20:56:39.206828 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 05 20:56:39.206828 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 20:56:39.206828 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 05 20:56:39.206828 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 05 20:56:39.206828 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 05 20:56:39.206828 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 05 20:56:39.206828 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 05 20:56:39.206828 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 05 20:56:39.206828 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 05 20:56:39.206828 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 05 20:56:39.206828 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 41985a43-8b24-478a-8b18-c8559af076c9 could not be found. Jul 05 20:56:39.206828 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi Jul 05 20:56:39.206828 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 20:56:39.206828 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi Jul 05 20:56:39.206828 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 20:56:39.206828 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 20:56:39.206828 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 20:56:39.206828 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 05 20:56:39.206828 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 05 20:56:39.206828 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 05 20:56:39.208341 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 05 20:56:39.208341 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 05 20:56:39.208341 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 05 20:56:39.208341 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 05 20:56:39.208341 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 05 20:56:39.208341 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 05 20:56:39.208341 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 05 20:56:39.208341 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 41985a43-8b24-478a-8b18-c8559af076c9 could not be found. Jul 05 20:56:39.208341 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi Jul 05 20:56:39.208341 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 20:56:39.208341 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi Jul 05 20:56:39.208341 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 20:56:39.208341 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 20:56:39.208341 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 20:56:39.208341 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 05 20:56:39.208341 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 05 20:56:39.208341 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 41985a43-8b24-478a-8b18-c8559af076c9 could not be found. Jul 05 20:56:39.208341 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi Jul 05 20:56:39.209622 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-24c58b4b-267f-4a58-85bd-2fed227705db tempest-VolumesActionsTest-1665182479 tempest-VolumesActionsTest-1665182479-project] Returning 404 to user: Instance 41985a43-8b24-478a-8b18-c8559af076c9 could not be found. {{(pid=117627) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 05 20:56:39.209622 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-24c58b4b-267f-4a58-85bd-2fed227705db tempest-VolumesActionsTest-1665182479 tempest-VolumesActionsTest-1665182479-project] 10.222.0.20 "GET /compute/v2.1/servers/41985a43-8b24-478a-8b18-c8559af076c9" status: 404 len: 111 microversion: 2.1 time: 0.050168 Jul 05 20:56:39.217074 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 141/290] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:56:39 2022] GET /compute/v2.1/servers/41985a43-8b24-478a-8b18-c8559af076c9 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 05 20:56:39.259716 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-35594116-533c-4e2d-a51c-f6ba891c7cfb tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:56:39.260424 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-35594116-533c-4e2d-a51c-f6ba891c7cfb tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] [instance: f236112c-4649-478b-a626-b84f8ff1bfe9] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:56:39.267383 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-35594116-533c-4e2d-a51c-f6ba891c7cfb tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:56:39.267837 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-35594116-533c-4e2d-a51c-f6ba891c7cfb tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:56:39.268830 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-35594116-533c-4e2d-a51c-f6ba891c7cfb tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:56:39.269304 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-35594116-533c-4e2d-a51c-f6ba891c7cfb tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:56:39.347935 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-dd3a0587-1cc3-47c0-8000-51fc584c3e3a tempest-VolumesActionsTest-1665182479 tempest-VolumesActionsTest-1665182479-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1575032384", "imageRef": "88e08f49-c01d-4849-a89f-b678588e56f4", "flavorRef": "452", "networks": [{"uuid": "2761cbb9-4367-450c-83c6-d327fdcfa178"}]}} {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 20:56:39.402853 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.network.neutron [None req-dd3a0587-1cc3-47c0-8000-51fc584c3e3a tempest-VolumesActionsTest-1665182479 tempest-VolumesActionsTest-1665182479-project] validate_networks() for [('2761cbb9-4367-450c-83c6-d327fdcfa178', None, None, None, None, None)] {{(pid=117627) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 05 20:56:39.461459 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-35594116-533c-4e2d-a51c-f6ba891c7cfb tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eac41ce3f04450b840cff305ec1a5ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47e1ad014d542f98f6b24c8a504d166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:56:39.470892 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-35594116-533c-4e2d-a51c-f6ba891c7cfb tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] 10.222.0.20 "GET /compute/v2.1/servers/f236112c-4649-478b-a626-b84f8ff1bfe9" status: 200 len: 1722 microversion: 2.1 time: 0.217785 Jul 05 20:56:39.471746 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 150/291] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:56:39 2022] GET /compute/v2.1/servers/f236112c-4649-478b-a626-b84f8ff1bfe9 => generated 1722 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 20:56:39.759774 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-8299e0d3-10b8-4631-a189-151b611d2be7 tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:56:39.760916 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-8299e0d3-10b8-4631-a189-151b611d2be7 tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] [instance: 7b18289e-137f-467c-96ec-cc6179f93e17] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:56:39.772066 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-8299e0d3-10b8-4631-a189-151b611d2be7 tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:56:39.772734 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-8299e0d3-10b8-4631-a189-151b611d2be7 tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:56:39.773799 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-8299e0d3-10b8-4631-a189-151b611d2be7 tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:56:39.774426 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-8299e0d3-10b8-4631-a189-151b611d2be7 tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:56:40.009879 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.virt.hardware [None req-dd3a0587-1cc3-47c0-8000-51fc584c3e3a tempest-VolumesActionsTest-1665182479 tempest-VolumesActionsTest-1665182479-project] Flavor limits 0:0:0 {{(pid=117627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 05 20:56:40.010723 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.virt.hardware [None req-dd3a0587-1cc3-47c0-8000-51fc584c3e3a tempest-VolumesActionsTest-1665182479 tempest-VolumesActionsTest-1665182479-project] Image limits 0:0:0 {{(pid=117627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 05 20:56:40.014058 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-8299e0d3-10b8-4631-a189-151b611d2be7 tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a4b471d14044069a5969e8bc6ca4f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3429e99ac2a94266b152e053bc6a0006', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:56:40.016603 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.virt.hardware [None req-dd3a0587-1cc3-47c0-8000-51fc584c3e3a tempest-VolumesActionsTest-1665182479 tempest-VolumesActionsTest-1665182479-project] Flavor pref 0:0:0 {{(pid=117627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 05 20:56:40.017443 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.virt.hardware [None req-dd3a0587-1cc3-47c0-8000-51fc584c3e3a tempest-VolumesActionsTest-1665182479 tempest-VolumesActionsTest-1665182479-project] Image pref 0:0:0 {{(pid=117627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 05 20:56:40.018974 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.virt.hardware [None req-dd3a0587-1cc3-47c0-8000-51fc584c3e3a tempest-VolumesActionsTest-1665182479 tempest-VolumesActionsTest-1665182479-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 05 20:56:40.023012 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-8299e0d3-10b8-4631-a189-151b611d2be7 tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] 10.222.0.20 "GET /compute/v2.1/servers/7b18289e-137f-467c-96ec-cc6179f93e17" status: 200 len: 1258 microversion: 2.1 time: 0.267962 Jul 05 20:56:40.024133 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 151/292] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:56:39 2022] GET /compute/v2.1/servers/7b18289e-137f-467c-96ec-cc6179f93e17 => generated 1258 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 20:56:40.031491 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-dd3a0587-1cc3-47c0-8000-51fc584c3e3a tempest-VolumesActionsTest-1665182479 tempest-VolumesActionsTest-1665182479-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:56:40.032198 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-dd3a0587-1cc3-47c0-8000-51fc584c3e3a tempest-VolumesActionsTest-1665182479 tempest-VolumesActionsTest-1665182479-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:56:40.033219 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-dd3a0587-1cc3-47c0-8000-51fc584c3e3a tempest-VolumesActionsTest-1665182479 tempest-VolumesActionsTest-1665182479-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:56:40.033828 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-dd3a0587-1cc3-47c0-8000-51fc584c3e3a tempest-VolumesActionsTest-1665182479 tempest-VolumesActionsTest-1665182479-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:56:40.053342 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.quota [None req-dd3a0587-1cc3-47c0-8000-51fc584c3e3a tempest-VolumesActionsTest-1665182479 tempest-VolumesActionsTest-1665182479-project] Getting quotas for project a407f0bf436c4987b9eb2e59c46d82a9. Resources: {'cores', 'ram', 'instances'} {{(pid=117627) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 05 20:56:40.058895 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.quota [None req-dd3a0587-1cc3-47c0-8000-51fc584c3e3a tempest-VolumesActionsTest-1665182479 tempest-VolumesActionsTest-1665182479-project] Getting quotas for user fd273630a84d41f49dcf8208c618f256 and project a407f0bf436c4987b9eb2e59c46d82a9. Resources: {'cores', 'ram', 'instances'} {{(pid=117627) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 05 20:56:40.076723 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-dd3a0587-1cc3-47c0-8000-51fc584c3e3a tempest-VolumesActionsTest-1665182479 tempest-VolumesActionsTest-1665182479-project] Going to run 1 instances... {{(pid=117627) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 05 20:56:40.079712 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-dd3a0587-1cc3-47c0-8000-51fc584c3e3a tempest-VolumesActionsTest-1665182479 tempest-VolumesActionsTest-1665182479-project] [instance: bdb608d6-12ec-4b1e-9dfb-71c341ec749e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='88e08f49-c01d-4849-a89f-b678588e56f4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117627) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 05 20:56:40.141348 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-dd3a0587-1cc3-47c0-8000-51fc584c3e3a tempest-VolumesActionsTest-1665182479 tempest-VolumesActionsTest-1665182479-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.795119 Jul 05 20:56:40.144395 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 142/293] 10.222.0.20 () {60 vars in 1146 bytes} [Tue Jul 5 20:56:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 801 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 05 20:56:40.152209 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-90ea3605-25d8-453d-bc68-1bedf06fc597 tempest-VolumesActionsTest-1665182479 tempest-VolumesActionsTest-1665182479-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:56:40.153595 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-90ea3605-25d8-453d-bc68-1bedf06fc597 tempest-VolumesActionsTest-1665182479 tempest-VolumesActionsTest-1665182479-project] [instance: bdb608d6-12ec-4b1e-9dfb-71c341ec749e] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:56:40.168117 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-46e3b4af-f089-4151-8257-70ceb3324383 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:56:40.168733 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-46e3b4af-f089-4151-8257-70ceb3324383 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] [instance: c6c3c1ea-31e8-4c65-b73d-669f337bee2f] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:56:40.177495 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-46e3b4af-f089-4151-8257-70ceb3324383 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:56:40.178031 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-46e3b4af-f089-4151-8257-70ceb3324383 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:56:40.178713 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-46e3b4af-f089-4151-8257-70ceb3324383 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:56:40.179331 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-46e3b4af-f089-4151-8257-70ceb3324383 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:56:40.297616 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-90ea3605-25d8-453d-bc68-1bedf06fc597 tempest-VolumesActionsTest-1665182479 tempest-VolumesActionsTest-1665182479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd273630a84d41f49dcf8208c618f256', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a407f0bf436c4987b9eb2e59c46d82a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:56:40.308037 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-90ea3605-25d8-453d-bc68-1bedf06fc597 tempest-VolumesActionsTest-1665182479 tempest-VolumesActionsTest-1665182479-project] 10.222.0.20 "GET /compute/v2.1/servers/bdb608d6-12ec-4b1e-9dfb-71c341ec749e" status: 200 len: 1214 microversion: 2.1 time: 0.159754 Jul 05 20:56:40.309186 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 152/294] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:56:40 2022] GET /compute/v2.1/servers/bdb608d6-12ec-4b1e-9dfb-71c341ec749e => generated 1214 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 20:56:40.323447 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-a21b053b-a2bd-444e-bf13-f165ff7889f5 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:56:40.324061 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-a21b053b-a2bd-444e-bf13-f165ff7889f5 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] [instance: 52848078-62a1-484f-813c-7b3352cb3851] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:56:40.337204 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-a21b053b-a2bd-444e-bf13-f165ff7889f5 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:56:40.337655 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-a21b053b-a2bd-444e-bf13-f165ff7889f5 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:56:40.342268 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-a21b053b-a2bd-444e-bf13-f165ff7889f5 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:56:40.344026 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-a21b053b-a2bd-444e-bf13-f165ff7889f5 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:56:40.848828 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-a21b053b-a2bd-444e-bf13-f165ff7889f5 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:56:40.869477 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-a21b053b-a2bd-444e-bf13-f165ff7889f5 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:56:40.876562 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-a21b053b-a2bd-444e-bf13-f165ff7889f5 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:56:40.881663 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-a21b053b-a2bd-444e-bf13-f165ff7889f5 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] 10.222.0.20 "GET /compute/v2.1/servers/52848078-62a1-484f-813c-7b3352cb3851" status: 200 len: 1719 microversion: 2.20 time: 0.571032 Jul 05 20:56:40.892303 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 153/295] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 5 20:56:40 2022] GET /compute/v2.1/servers/52848078-62a1-484f-813c-7b3352cb3851 => generated 1719 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 20:56:40.899760 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-d43c209b-ff97-4861-a2b1-8a12f2b9214f tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:56:40.904808 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-d43c209b-ff97-4861-a2b1-8a12f2b9214f tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] [instance: f236112c-4649-478b-a626-b84f8ff1bfe9] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:56:40.916591 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-d43c209b-ff97-4861-a2b1-8a12f2b9214f tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:56:40.917100 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-d43c209b-ff97-4861-a2b1-8a12f2b9214f tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:56:40.918096 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-d43c209b-ff97-4861-a2b1-8a12f2b9214f tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:56:40.918681 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-d43c209b-ff97-4861-a2b1-8a12f2b9214f tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:56:40.991674 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-46e3b4af-f089-4151-8257-70ceb3324383 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd152763a64794301b21587ab2b395bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc6d47f96d17471d94367bc8f8a3e3f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:56:40.999736 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-46e3b4af-f089-4151-8257-70ceb3324383 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] 10.222.0.20 "GET /compute/v2.1/servers/c6c3c1ea-31e8-4c65-b73d-669f337bee2f" status: 200 len: 1370 microversion: 2.1 time: 0.835500 Jul 05 20:56:41.001147 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 143/296] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:56:40 2022] GET /compute/v2.1/servers/c6c3c1ea-31e8-4c65-b73d-669f337bee2f => generated 1370 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 20:56:41.041986 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-4af4eab7-414c-4f98-a52f-8c2acb85caac tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:56:41.042954 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-4af4eab7-414c-4f98-a52f-8c2acb85caac tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] [instance: 7b18289e-137f-467c-96ec-cc6179f93e17] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:56:41.051137 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-4af4eab7-414c-4f98-a52f-8c2acb85caac tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:56:41.051792 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-4af4eab7-414c-4f98-a52f-8c2acb85caac tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:56:41.052762 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-4af4eab7-414c-4f98-a52f-8c2acb85caac tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:56:41.053716 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-4af4eab7-414c-4f98-a52f-8c2acb85caac tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:56:41.302505 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-d43c209b-ff97-4861-a2b1-8a12f2b9214f tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eac41ce3f04450b840cff305ec1a5ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47e1ad014d542f98f6b24c8a504d166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:56:41.328411 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-d43c209b-ff97-4861-a2b1-8a12f2b9214f tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] 10.222.0.20 "GET /compute/v2.1/servers/f236112c-4649-478b-a626-b84f8ff1bfe9" status: 200 len: 1722 microversion: 2.1 time: 0.433535 Jul 05 20:56:41.343465 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 154/297] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:56:40 2022] GET /compute/v2.1/servers/f236112c-4649-478b-a626-b84f8ff1bfe9 => generated 1722 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 20:56:41.348456 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-cb083b61-4fe8-4d89-8c83-6087eb564ca1 tempest-VolumesActionsTest-1665182479 tempest-VolumesActionsTest-1665182479-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:56:41.349123 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-cb083b61-4fe8-4d89-8c83-6087eb564ca1 tempest-VolumesActionsTest-1665182479 tempest-VolumesActionsTest-1665182479-project] [instance: bdb608d6-12ec-4b1e-9dfb-71c341ec749e] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:56:41.358128 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-cb083b61-4fe8-4d89-8c83-6087eb564ca1 tempest-VolumesActionsTest-1665182479 tempest-VolumesActionsTest-1665182479-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:56:41.359936 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-cb083b61-4fe8-4d89-8c83-6087eb564ca1 tempest-VolumesActionsTest-1665182479 tempest-VolumesActionsTest-1665182479-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:56:41.362020 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-cb083b61-4fe8-4d89-8c83-6087eb564ca1 tempest-VolumesActionsTest-1665182479 tempest-VolumesActionsTest-1665182479-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:56:41.363554 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-cb083b61-4fe8-4d89-8c83-6087eb564ca1 tempest-VolumesActionsTest-1665182479 tempest-VolumesActionsTest-1665182479-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:56:41.455075 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-4af4eab7-414c-4f98-a52f-8c2acb85caac tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a4b471d14044069a5969e8bc6ca4f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3429e99ac2a94266b152e053bc6a0006', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:56:41.466433 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-4af4eab7-414c-4f98-a52f-8c2acb85caac tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] 10.222.0.20 "GET /compute/v2.1/servers/7b18289e-137f-467c-96ec-cc6179f93e17" status: 200 len: 1258 microversion: 2.1 time: 0.428384 Jul 05 20:56:41.467263 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 144/298] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:56:41 2022] GET /compute/v2.1/servers/7b18289e-137f-467c-96ec-cc6179f93e17 => generated 1258 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 20:56:41.510234 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-cb083b61-4fe8-4d89-8c83-6087eb564ca1 tempest-VolumesActionsTest-1665182479 tempest-VolumesActionsTest-1665182479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd273630a84d41f49dcf8208c618f256', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a407f0bf436c4987b9eb2e59c46d82a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:56:41.519869 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-cb083b61-4fe8-4d89-8c83-6087eb564ca1 tempest-VolumesActionsTest-1665182479 tempest-VolumesActionsTest-1665182479-project] 10.222.0.20 "GET /compute/v2.1/servers/bdb608d6-12ec-4b1e-9dfb-71c341ec749e" status: 200 len: 1266 microversion: 2.1 time: 0.174947 Jul 05 20:56:41.521310 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 155/299] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:56:41 2022] GET /compute/v2.1/servers/bdb608d6-12ec-4b1e-9dfb-71c341ec749e => generated 1266 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 20:56:41.901242 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-759c9825-88c6-40ff-9752-922534a189fb tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:56:41.902359 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-759c9825-88c6-40ff-9752-922534a189fb tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] [instance: 52848078-62a1-484f-813c-7b3352cb3851] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:56:41.909790 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-759c9825-88c6-40ff-9752-922534a189fb tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:56:41.910241 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-759c9825-88c6-40ff-9752-922534a189fb tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:56:41.911019 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-759c9825-88c6-40ff-9752-922534a189fb tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:56:41.911452 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-759c9825-88c6-40ff-9752-922534a189fb tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:56:42.021386 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-34d1cfba-471b-4699-9395-5c94771a54eb tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:56:42.022528 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-34d1cfba-471b-4699-9395-5c94771a54eb tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] [instance: c6c3c1ea-31e8-4c65-b73d-669f337bee2f] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:56:42.029931 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-34d1cfba-471b-4699-9395-5c94771a54eb tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:56:42.031108 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-34d1cfba-471b-4699-9395-5c94771a54eb tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:56:42.031897 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-34d1cfba-471b-4699-9395-5c94771a54eb tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:56:42.032340 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-34d1cfba-471b-4699-9395-5c94771a54eb tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:56:42.057016 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-759c9825-88c6-40ff-9752-922534a189fb tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:56:42.066480 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-759c9825-88c6-40ff-9752-922534a189fb tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:56:42.068004 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-759c9825-88c6-40ff-9752-922534a189fb tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:56:42.069415 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-759c9825-88c6-40ff-9752-922534a189fb tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] 10.222.0.20 "GET /compute/v2.1/servers/52848078-62a1-484f-813c-7b3352cb3851" status: 200 len: 1719 microversion: 2.20 time: 0.173164 Jul 05 20:56:42.070689 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 145/300] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 5 20:56:41 2022] GET /compute/v2.1/servers/52848078-62a1-484f-813c-7b3352cb3851 => generated 1719 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 20:56:42.174298 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-34d1cfba-471b-4699-9395-5c94771a54eb tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd152763a64794301b21587ab2b395bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc6d47f96d17471d94367bc8f8a3e3f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:56:42.181931 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-34d1cfba-471b-4699-9395-5c94771a54eb tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] 10.222.0.20 "GET /compute/v2.1/servers/c6c3c1ea-31e8-4c65-b73d-669f337bee2f" status: 200 len: 1370 microversion: 2.1 time: 0.165498 Jul 05 20:56:42.183237 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 156/301] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:56:42 2022] GET /compute/v2.1/servers/c6c3c1ea-31e8-4c65-b73d-669f337bee2f => generated 1370 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 20:56:42.346349 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-d038db92-dcc5-4858-96ef-400572046be0 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:56:42.346966 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-d038db92-dcc5-4858-96ef-400572046be0 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] [instance: f236112c-4649-478b-a626-b84f8ff1bfe9] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:56:42.353784 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-d038db92-dcc5-4858-96ef-400572046be0 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:56:42.354229 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-d038db92-dcc5-4858-96ef-400572046be0 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:56:42.355005 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-d038db92-dcc5-4858-96ef-400572046be0 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:56:42.355436 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-d038db92-dcc5-4858-96ef-400572046be0 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:56:42.487885 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-2f959970-2450-4bee-bc85-d8339b8854ed tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:56:42.489835 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-2f959970-2450-4bee-bc85-d8339b8854ed tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] [instance: 7b18289e-137f-467c-96ec-cc6179f93e17] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:56:42.508972 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-2f959970-2450-4bee-bc85-d8339b8854ed tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:56:42.509733 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-2f959970-2450-4bee-bc85-d8339b8854ed tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:56:42.511264 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-2f959970-2450-4bee-bc85-d8339b8854ed tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:56:42.516190 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-2f959970-2450-4bee-bc85-d8339b8854ed tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:56:42.785208 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-d038db92-dcc5-4858-96ef-400572046be0 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eac41ce3f04450b840cff305ec1a5ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47e1ad014d542f98f6b24c8a504d166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:56:42.804592 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-d038db92-dcc5-4858-96ef-400572046be0 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] 10.222.0.20 "GET /compute/v2.1/servers/f236112c-4649-478b-a626-b84f8ff1bfe9" status: 200 len: 1722 microversion: 2.1 time: 0.462836 Jul 05 20:56:42.807218 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 146/302] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:56:42 2022] GET /compute/v2.1/servers/f236112c-4649-478b-a626-b84f8ff1bfe9 => generated 1722 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 20:56:42.825018 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-eaefb64b-0b5f-4c8b-84b0-976252f1dbd9 tempest-VolumesActionsTest-1665182479 tempest-VolumesActionsTest-1665182479-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:56:42.825579 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-eaefb64b-0b5f-4c8b-84b0-976252f1dbd9 tempest-VolumesActionsTest-1665182479 tempest-VolumesActionsTest-1665182479-project] [instance: bdb608d6-12ec-4b1e-9dfb-71c341ec749e] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:56:42.839259 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-eaefb64b-0b5f-4c8b-84b0-976252f1dbd9 tempest-VolumesActionsTest-1665182479 tempest-VolumesActionsTest-1665182479-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:56:42.839715 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-eaefb64b-0b5f-4c8b-84b0-976252f1dbd9 tempest-VolumesActionsTest-1665182479 tempest-VolumesActionsTest-1665182479-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:56:42.840499 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-eaefb64b-0b5f-4c8b-84b0-976252f1dbd9 tempest-VolumesActionsTest-1665182479 tempest-VolumesActionsTest-1665182479-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:56:42.842194 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-eaefb64b-0b5f-4c8b-84b0-976252f1dbd9 tempest-VolumesActionsTest-1665182479 tempest-VolumesActionsTest-1665182479-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:56:42.845573 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-2f959970-2450-4bee-bc85-d8339b8854ed tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a4b471d14044069a5969e8bc6ca4f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3429e99ac2a94266b152e053bc6a0006', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:56:42.854833 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-2f959970-2450-4bee-bc85-d8339b8854ed tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] 10.222.0.20 "GET /compute/v2.1/servers/7b18289e-137f-467c-96ec-cc6179f93e17" status: 200 len: 1258 microversion: 2.1 time: 0.373291 Jul 05 20:56:42.856105 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 157/303] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:56:42 2022] GET /compute/v2.1/servers/7b18289e-137f-467c-96ec-cc6179f93e17 => generated 1258 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 20:56:42.958173 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-eaefb64b-0b5f-4c8b-84b0-976252f1dbd9 tempest-VolumesActionsTest-1665182479 tempest-VolumesActionsTest-1665182479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd273630a84d41f49dcf8208c618f256', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a407f0bf436c4987b9eb2e59c46d82a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:56:42.968662 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-eaefb64b-0b5f-4c8b-84b0-976252f1dbd9 tempest-VolumesActionsTest-1665182479 tempest-VolumesActionsTest-1665182479-project] 10.222.0.20 "GET /compute/v2.1/servers/bdb608d6-12ec-4b1e-9dfb-71c341ec749e" status: 200 len: 1272 microversion: 2.1 time: 0.152316 Jul 05 20:56:42.969337 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 147/304] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:56:42 2022] GET /compute/v2.1/servers/bdb608d6-12ec-4b1e-9dfb-71c341ec749e => generated 1272 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 20:56:43.089511 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-af03876e-6519-4285-9fd6-9b5995bd621c tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:56:43.090425 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-af03876e-6519-4285-9fd6-9b5995bd621c tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] [instance: 52848078-62a1-484f-813c-7b3352cb3851] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:56:43.098726 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-af03876e-6519-4285-9fd6-9b5995bd621c tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:56:43.099175 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-af03876e-6519-4285-9fd6-9b5995bd621c tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:56:43.099949 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-af03876e-6519-4285-9fd6-9b5995bd621c tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:56:43.100384 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-af03876e-6519-4285-9fd6-9b5995bd621c tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:56:43.198892 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-9b92ef43-0a79-4c68-99f5-8486c059a1b0 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:56:43.199502 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-9b92ef43-0a79-4c68-99f5-8486c059a1b0 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] [instance: c6c3c1ea-31e8-4c65-b73d-669f337bee2f] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:56:43.206067 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-9b92ef43-0a79-4c68-99f5-8486c059a1b0 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:56:43.206775 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-9b92ef43-0a79-4c68-99f5-8486c059a1b0 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:56:43.207703 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-9b92ef43-0a79-4c68-99f5-8486c059a1b0 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:56:43.208295 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-9b92ef43-0a79-4c68-99f5-8486c059a1b0 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:56:43.261392 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-af03876e-6519-4285-9fd6-9b5995bd621c tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:56:43.271918 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-af03876e-6519-4285-9fd6-9b5995bd621c tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:56:43.273972 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-af03876e-6519-4285-9fd6-9b5995bd621c tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:56:43.275542 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-af03876e-6519-4285-9fd6-9b5995bd621c tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] 10.222.0.20 "GET /compute/v2.1/servers/52848078-62a1-484f-813c-7b3352cb3851" status: 200 len: 1719 microversion: 2.20 time: 0.190766 Jul 05 20:56:43.276252 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 158/305] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 5 20:56:43 2022] GET /compute/v2.1/servers/52848078-62a1-484f-813c-7b3352cb3851 => generated 1719 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 20:56:43.371646 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-9b92ef43-0a79-4c68-99f5-8486c059a1b0 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd152763a64794301b21587ab2b395bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc6d47f96d17471d94367bc8f8a3e3f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:56:43.381599 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-9b92ef43-0a79-4c68-99f5-8486c059a1b0 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] 10.222.0.20 "GET /compute/v2.1/servers/c6c3c1ea-31e8-4c65-b73d-669f337bee2f" status: 200 len: 1370 microversion: 2.1 time: 0.186175 Jul 05 20:56:43.382543 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 148/306] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:56:43 2022] GET /compute/v2.1/servers/c6c3c1ea-31e8-4c65-b73d-669f337bee2f => generated 1370 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 20:56:43.822470 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-f72f1efe-625c-49c1-905f-c2b034dd3194 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:56:43.823884 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-f72f1efe-625c-49c1-905f-c2b034dd3194 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] [instance: f236112c-4649-478b-a626-b84f8ff1bfe9] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:56:43.832531 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-f72f1efe-625c-49c1-905f-c2b034dd3194 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:56:43.832998 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-f72f1efe-625c-49c1-905f-c2b034dd3194 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:56:43.833779 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-f72f1efe-625c-49c1-905f-c2b034dd3194 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:56:43.834255 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-f72f1efe-625c-49c1-905f-c2b034dd3194 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:56:43.872811 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-f6b00511-d58b-40b6-96b9-b5ca713735b2 tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:56:43.873445 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-f6b00511-d58b-40b6-96b9-b5ca713735b2 tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] [instance: 7b18289e-137f-467c-96ec-cc6179f93e17] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:56:43.880117 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-f6b00511-d58b-40b6-96b9-b5ca713735b2 tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:56:43.880480 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-f6b00511-d58b-40b6-96b9-b5ca713735b2 tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:56:43.881507 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-f6b00511-d58b-40b6-96b9-b5ca713735b2 tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:56:43.881982 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-f6b00511-d58b-40b6-96b9-b5ca713735b2 tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:56:44.056739 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-f72f1efe-625c-49c1-905f-c2b034dd3194 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eac41ce3f04450b840cff305ec1a5ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47e1ad014d542f98f6b24c8a504d166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:56:44.068117 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-f72f1efe-625c-49c1-905f-c2b034dd3194 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] 10.222.0.20 "GET /compute/v2.1/servers/f236112c-4649-478b-a626-b84f8ff1bfe9" status: 200 len: 1722 microversion: 2.1 time: 0.249164 Jul 05 20:56:44.077844 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 159/307] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:56:43 2022] GET /compute/v2.1/servers/f236112c-4649-478b-a626-b84f8ff1bfe9 => generated 1722 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 20:56:44.077844 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-c036a213-9966-4e67-8b3b-618b2d7455e4 tempest-VolumesActionsTest-1665182479 tempest-VolumesActionsTest-1665182479-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:56:44.077844 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-c036a213-9966-4e67-8b3b-618b2d7455e4 tempest-VolumesActionsTest-1665182479 tempest-VolumesActionsTest-1665182479-project] [instance: bdb608d6-12ec-4b1e-9dfb-71c341ec749e] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:56:44.081487 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-c036a213-9966-4e67-8b3b-618b2d7455e4 tempest-VolumesActionsTest-1665182479 tempest-VolumesActionsTest-1665182479-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:56:44.081929 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-c036a213-9966-4e67-8b3b-618b2d7455e4 tempest-VolumesActionsTest-1665182479 tempest-VolumesActionsTest-1665182479-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:56:44.082858 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-c036a213-9966-4e67-8b3b-618b2d7455e4 tempest-VolumesActionsTest-1665182479 tempest-VolumesActionsTest-1665182479-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:56:44.083268 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-c036a213-9966-4e67-8b3b-618b2d7455e4 tempest-VolumesActionsTest-1665182479 tempest-VolumesActionsTest-1665182479-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:56:44.085717 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-f6b00511-d58b-40b6-96b9-b5ca713735b2 tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a4b471d14044069a5969e8bc6ca4f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3429e99ac2a94266b152e053bc6a0006', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:56:44.097443 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-f6b00511-d58b-40b6-96b9-b5ca713735b2 tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] 10.222.0.20 "GET /compute/v2.1/servers/7b18289e-137f-467c-96ec-cc6179f93e17" status: 200 len: 1258 microversion: 2.1 time: 0.228133 Jul 05 20:56:44.098399 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 149/308] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:56:43 2022] GET /compute/v2.1/servers/7b18289e-137f-467c-96ec-cc6179f93e17 => generated 1258 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 20:56:44.193957 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [req-36c5c267-af58-4901-bfe1-4de199d9fd5c req-c1a77f35-898c-4e8c-83a7-70286d77a53e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bdb608d6-12ec-4b1e-9dfb-71c341ec749e", "tag": "0b46cd99-b04f-4b5c-8249-0fb811d094e0"}]} {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 20:56:44.206066 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [req-36c5c267-af58-4901-bfe1-4de199d9fd5c req-c1a77f35-898c-4e8c-83a7-70286d77a53e service nova] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:56:44.206903 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [req-36c5c267-af58-4901-bfe1-4de199d9fd5c req-c1a77f35-898c-4e8c-83a7-70286d77a53e service nova] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:56:44.232585 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.compute.server_external_events [req-36c5c267-af58-4901-bfe1-4de199d9fd5c req-c1a77f35-898c-4e8c-83a7-70286d77a53e service nova] Creating event network-changed:0b46cd99-b04f-4b5c-8249-0fb811d094e0 for instance bdb608d6-12ec-4b1e-9dfb-71c341ec749e on hv-cinder-79760 Jul 05 20:56:44.239211 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [req-36c5c267-af58-4901-bfe1-4de199d9fd5c req-c1a77f35-898c-4e8c-83a7-70286d77a53e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048801 Jul 05 20:56:44.240708 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 150/309] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 5 20:56:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 05 20:56:44.252829 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-c036a213-9966-4e67-8b3b-618b2d7455e4 tempest-VolumesActionsTest-1665182479 tempest-VolumesActionsTest-1665182479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd273630a84d41f49dcf8208c618f256', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a407f0bf436c4987b9eb2e59c46d82a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:56:44.260248 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-c036a213-9966-4e67-8b3b-618b2d7455e4 tempest-VolumesActionsTest-1665182479 tempest-VolumesActionsTest-1665182479-project] 10.222.0.20 "GET /compute/v2.1/servers/bdb608d6-12ec-4b1e-9dfb-71c341ec749e" status: 200 len: 1314 microversion: 2.1 time: 0.189960 Jul 05 20:56:44.260800 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 160/310] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:56:44 2022] GET /compute/v2.1/servers/bdb608d6-12ec-4b1e-9dfb-71c341ec749e => generated 1314 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 20:56:44.294340 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-ef1461df-f374-4800-bfdd-34a7aa021e77 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:56:44.295024 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-ef1461df-f374-4800-bfdd-34a7aa021e77 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] [instance: 52848078-62a1-484f-813c-7b3352cb3851] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:56:44.301786 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-ef1461df-f374-4800-bfdd-34a7aa021e77 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:56:44.302222 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-ef1461df-f374-4800-bfdd-34a7aa021e77 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:56:44.303049 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-ef1461df-f374-4800-bfdd-34a7aa021e77 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:56:44.303420 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-ef1461df-f374-4800-bfdd-34a7aa021e77 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:56:44.400175 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-d3e665c2-402f-4dc6-8186-a2a65d00dec2 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:56:44.401170 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-d3e665c2-402f-4dc6-8186-a2a65d00dec2 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] [instance: c6c3c1ea-31e8-4c65-b73d-669f337bee2f] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:56:44.408830 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-d3e665c2-402f-4dc6-8186-a2a65d00dec2 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:56:44.409666 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-d3e665c2-402f-4dc6-8186-a2a65d00dec2 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:56:44.410822 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-d3e665c2-402f-4dc6-8186-a2a65d00dec2 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:56:44.411375 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-d3e665c2-402f-4dc6-8186-a2a65d00dec2 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:56:44.442812 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-ef1461df-f374-4800-bfdd-34a7aa021e77 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:56:44.455341 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-ef1461df-f374-4800-bfdd-34a7aa021e77 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:56:44.457061 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-ef1461df-f374-4800-bfdd-34a7aa021e77 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:56:44.458279 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-ef1461df-f374-4800-bfdd-34a7aa021e77 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] 10.222.0.20 "GET /compute/v2.1/servers/52848078-62a1-484f-813c-7b3352cb3851" status: 200 len: 1719 microversion: 2.20 time: 0.168251 Jul 05 20:56:44.458840 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 151/311] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 5 20:56:44 2022] GET /compute/v2.1/servers/52848078-62a1-484f-813c-7b3352cb3851 => generated 1719 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 20:56:44.569287 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-d3e665c2-402f-4dc6-8186-a2a65d00dec2 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd152763a64794301b21587ab2b395bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc6d47f96d17471d94367bc8f8a3e3f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:56:44.577783 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-d3e665c2-402f-4dc6-8186-a2a65d00dec2 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] 10.222.0.20 "GET /compute/v2.1/servers/c6c3c1ea-31e8-4c65-b73d-669f337bee2f" status: 200 len: 1370 microversion: 2.1 time: 0.181180 Jul 05 20:56:44.578367 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 161/312] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:56:44 2022] GET /compute/v2.1/servers/c6c3c1ea-31e8-4c65-b73d-669f337bee2f => generated 1370 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 20:56:44.814434 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [req-a1da028d-b1ab-43f6-8fd6-84ee2d00e1b3 req-a6e9f92c-d72b-4141-b649-22cf3057e560 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c6c3c1ea-31e8-4c65-b73d-669f337bee2f", "name": "network-vif-plugged", "status": "completed", "tag": "895e5d50-4373-406a-8f11-70a9e025443e"}]} {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 20:56:44.824383 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [req-a1da028d-b1ab-43f6-8fd6-84ee2d00e1b3 req-a6e9f92c-d72b-4141-b649-22cf3057e560 service nova] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:56:44.825450 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [req-a1da028d-b1ab-43f6-8fd6-84ee2d00e1b3 req-a6e9f92c-d72b-4141-b649-22cf3057e560 service nova] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:56:44.838410 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.compute.server_external_events [req-a1da028d-b1ab-43f6-8fd6-84ee2d00e1b3 req-a6e9f92c-d72b-4141-b649-22cf3057e560 service nova] Creating event network-vif-plugged:895e5d50-4373-406a-8f11-70a9e025443e for instance c6c3c1ea-31e8-4c65-b73d-669f337bee2f on hv-cinder-79760 Jul 05 20:56:44.843674 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [req-a1da028d-b1ab-43f6-8fd6-84ee2d00e1b3 req-a6e9f92c-d72b-4141-b649-22cf3057e560 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033965 Jul 05 20:56:44.845444 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 152/313] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 5 20:56:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 20:56:45.085315 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-64e4b50b-ba9d-4b74-a2d0-6b8687a58140 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:56:45.085924 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-64e4b50b-ba9d-4b74-a2d0-6b8687a58140 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] [instance: f236112c-4649-478b-a626-b84f8ff1bfe9] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:56:45.094548 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-64e4b50b-ba9d-4b74-a2d0-6b8687a58140 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:56:45.094825 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-64e4b50b-ba9d-4b74-a2d0-6b8687a58140 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:56:45.095574 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-64e4b50b-ba9d-4b74-a2d0-6b8687a58140 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:56:45.096039 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-64e4b50b-ba9d-4b74-a2d0-6b8687a58140 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:56:45.115147 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-d508c5f6-69d0-480c-b228-0e311e558d3b tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:56:45.116881 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-d508c5f6-69d0-480c-b228-0e311e558d3b tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] [instance: 7b18289e-137f-467c-96ec-cc6179f93e17] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:56:45.125241 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-d508c5f6-69d0-480c-b228-0e311e558d3b tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:56:45.125241 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-d508c5f6-69d0-480c-b228-0e311e558d3b tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:56:45.125751 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-d508c5f6-69d0-480c-b228-0e311e558d3b tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:56:45.126213 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-d508c5f6-69d0-480c-b228-0e311e558d3b tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:56:45.313118 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-64e4b50b-ba9d-4b74-a2d0-6b8687a58140 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eac41ce3f04450b840cff305ec1a5ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47e1ad014d542f98f6b24c8a504d166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:56:45.321205 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-64e4b50b-ba9d-4b74-a2d0-6b8687a58140 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] 10.222.0.20 "GET /compute/v2.1/servers/f236112c-4649-478b-a626-b84f8ff1bfe9" status: 200 len: 1722 microversion: 2.1 time: 0.239646 Jul 05 20:56:45.321358 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-d508c5f6-69d0-480c-b228-0e311e558d3b tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a4b471d14044069a5969e8bc6ca4f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3429e99ac2a94266b152e053bc6a0006', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:56:45.321774 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 162/314] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:56:45 2022] GET /compute/v2.1/servers/f236112c-4649-478b-a626-b84f8ff1bfe9 => generated 1722 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 20:56:45.326161 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-20129878-1b39-4fd0-b644-361b1e2081e0 tempest-VolumesActionsTest-1665182479 tempest-VolumesActionsTest-1665182479-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:56:45.327052 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-20129878-1b39-4fd0-b644-361b1e2081e0 tempest-VolumesActionsTest-1665182479 tempest-VolumesActionsTest-1665182479-project] [instance: bdb608d6-12ec-4b1e-9dfb-71c341ec749e] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:56:45.329432 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-d508c5f6-69d0-480c-b228-0e311e558d3b tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] 10.222.0.20 "GET /compute/v2.1/servers/7b18289e-137f-467c-96ec-cc6179f93e17" status: 200 len: 1258 microversion: 2.1 time: 0.218544 Jul 05 20:56:45.329985 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 153/315] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:56:45 2022] GET /compute/v2.1/servers/7b18289e-137f-467c-96ec-cc6179f93e17 => generated 1258 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 20:56:45.334279 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-20129878-1b39-4fd0-b644-361b1e2081e0 tempest-VolumesActionsTest-1665182479 tempest-VolumesActionsTest-1665182479-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:56:45.334836 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-20129878-1b39-4fd0-b644-361b1e2081e0 tempest-VolumesActionsTest-1665182479 tempest-VolumesActionsTest-1665182479-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:56:45.335718 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-20129878-1b39-4fd0-b644-361b1e2081e0 tempest-VolumesActionsTest-1665182479 tempest-VolumesActionsTest-1665182479-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:56:45.336406 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-20129878-1b39-4fd0-b644-361b1e2081e0 tempest-VolumesActionsTest-1665182479 tempest-VolumesActionsTest-1665182479-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:56:45.472429 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-20129878-1b39-4fd0-b644-361b1e2081e0 tempest-VolumesActionsTest-1665182479 tempest-VolumesActionsTest-1665182479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd273630a84d41f49dcf8208c618f256', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a407f0bf436c4987b9eb2e59c46d82a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:56:45.477243 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-468ac4b2-90be-4c75-b6c6-546aecbbb40f tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:56:45.477844 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-468ac4b2-90be-4c75-b6c6-546aecbbb40f tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] [instance: 52848078-62a1-484f-813c-7b3352cb3851] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:56:45.482262 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-20129878-1b39-4fd0-b644-361b1e2081e0 tempest-VolumesActionsTest-1665182479 tempest-VolumesActionsTest-1665182479-project] 10.222.0.20 "GET /compute/v2.1/servers/bdb608d6-12ec-4b1e-9dfb-71c341ec749e" status: 200 len: 1314 microversion: 2.1 time: 0.159444 Jul 05 20:56:45.482854 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 163/316] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:56:45 2022] GET /compute/v2.1/servers/bdb608d6-12ec-4b1e-9dfb-71c341ec749e => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 20:56:45.485830 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-468ac4b2-90be-4c75-b6c6-546aecbbb40f tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:56:45.486278 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-468ac4b2-90be-4c75-b6c6-546aecbbb40f tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:56:45.487042 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-468ac4b2-90be-4c75-b6c6-546aecbbb40f tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:56:45.487469 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-468ac4b2-90be-4c75-b6c6-546aecbbb40f tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:56:45.595553 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-663a4c08-0346-47c4-8f5f-0c16f21b58ad tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:56:45.596466 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-663a4c08-0346-47c4-8f5f-0c16f21b58ad tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] [instance: c6c3c1ea-31e8-4c65-b73d-669f337bee2f] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:56:45.603218 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-663a4c08-0346-47c4-8f5f-0c16f21b58ad tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:56:45.603659 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-663a4c08-0346-47c4-8f5f-0c16f21b58ad tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:56:45.604566 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-663a4c08-0346-47c4-8f5f-0c16f21b58ad tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:56:45.605029 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-663a4c08-0346-47c4-8f5f-0c16f21b58ad tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:56:45.634020 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-468ac4b2-90be-4c75-b6c6-546aecbbb40f tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:56:45.643777 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-468ac4b2-90be-4c75-b6c6-546aecbbb40f tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:56:45.645312 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-468ac4b2-90be-4c75-b6c6-546aecbbb40f tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:56:45.646478 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-468ac4b2-90be-4c75-b6c6-546aecbbb40f tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] 10.222.0.20 "GET /compute/v2.1/servers/52848078-62a1-484f-813c-7b3352cb3851" status: 200 len: 1719 microversion: 2.20 time: 0.173150 Jul 05 20:56:45.647034 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 154/317] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 5 20:56:45 2022] GET /compute/v2.1/servers/52848078-62a1-484f-813c-7b3352cb3851 => generated 1719 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 20:56:45.740382 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-663a4c08-0346-47c4-8f5f-0c16f21b58ad tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd152763a64794301b21587ab2b395bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc6d47f96d17471d94367bc8f8a3e3f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:56:45.748059 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-663a4c08-0346-47c4-8f5f-0c16f21b58ad tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] 10.222.0.20 "GET /compute/v2.1/servers/c6c3c1ea-31e8-4c65-b73d-669f337bee2f" status: 200 len: 1370 microversion: 2.1 time: 0.157391 Jul 05 20:56:45.748621 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 164/318] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:56:45 2022] GET /compute/v2.1/servers/c6c3c1ea-31e8-4c65-b73d-669f337bee2f => generated 1370 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 20:56:46.338205 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-3cd1af69-8cba-47b6-a986-a7df9a18b073 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:56:46.338815 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-3cd1af69-8cba-47b6-a986-a7df9a18b073 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] [instance: f236112c-4649-478b-a626-b84f8ff1bfe9] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:56:46.345456 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-3cd1af69-8cba-47b6-a986-a7df9a18b073 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:56:46.345728 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-4c3b05f3-d5dc-44cb-b27e-6cbb1ba27988 tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:56:46.346136 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-3cd1af69-8cba-47b6-a986-a7df9a18b073 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:56:46.346344 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-4c3b05f3-d5dc-44cb-b27e-6cbb1ba27988 tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] [instance: 7b18289e-137f-467c-96ec-cc6179f93e17] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:56:46.346814 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-3cd1af69-8cba-47b6-a986-a7df9a18b073 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:56:46.347252 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-3cd1af69-8cba-47b6-a986-a7df9a18b073 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:56:46.352839 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-4c3b05f3-d5dc-44cb-b27e-6cbb1ba27988 tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:56:46.353427 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-4c3b05f3-d5dc-44cb-b27e-6cbb1ba27988 tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:56:46.354349 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-4c3b05f3-d5dc-44cb-b27e-6cbb1ba27988 tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:56:46.354794 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-4c3b05f3-d5dc-44cb-b27e-6cbb1ba27988 tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:56:46.584261 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-3cd1af69-8cba-47b6-a986-a7df9a18b073 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eac41ce3f04450b840cff305ec1a5ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47e1ad014d542f98f6b24c8a504d166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:56:46.593736 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-3cd1af69-8cba-47b6-a986-a7df9a18b073 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] 10.222.0.20 "GET /compute/v2.1/servers/f236112c-4649-478b-a626-b84f8ff1bfe9" status: 200 len: 1722 microversion: 2.1 time: 0.259315 Jul 05 20:56:46.594683 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 155/319] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:56:46 2022] GET /compute/v2.1/servers/f236112c-4649-478b-a626-b84f8ff1bfe9 => generated 1722 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 20:56:46.604764 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-4c3b05f3-d5dc-44cb-b27e-6cbb1ba27988 tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a4b471d14044069a5969e8bc6ca4f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3429e99ac2a94266b152e053bc6a0006', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:56:46.610758 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-b451a339-7183-4b32-9af4-25b0acfada80 tempest-VolumesActionsTest-1665182479 tempest-VolumesActionsTest-1665182479-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:56:46.611592 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-b451a339-7183-4b32-9af4-25b0acfada80 tempest-VolumesActionsTest-1665182479 tempest-VolumesActionsTest-1665182479-project] [instance: bdb608d6-12ec-4b1e-9dfb-71c341ec749e] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:56:46.615062 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-4c3b05f3-d5dc-44cb-b27e-6cbb1ba27988 tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] 10.222.0.20 "GET /compute/v2.1/servers/7b18289e-137f-467c-96ec-cc6179f93e17" status: 200 len: 1258 microversion: 2.1 time: 0.272645 Jul 05 20:56:46.619168 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-b451a339-7183-4b32-9af4-25b0acfada80 tempest-VolumesActionsTest-1665182479 tempest-VolumesActionsTest-1665182479-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:56:46.619794 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-b451a339-7183-4b32-9af4-25b0acfada80 tempest-VolumesActionsTest-1665182479 tempest-VolumesActionsTest-1665182479-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:56:46.620907 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-b451a339-7183-4b32-9af4-25b0acfada80 tempest-VolumesActionsTest-1665182479 tempest-VolumesActionsTest-1665182479-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:56:46.621854 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-b451a339-7183-4b32-9af4-25b0acfada80 tempest-VolumesActionsTest-1665182479 tempest-VolumesActionsTest-1665182479-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:56:46.624663 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 165/320] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:56:46 2022] GET /compute/v2.1/servers/7b18289e-137f-467c-96ec-cc6179f93e17 => generated 1258 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 20:56:46.666870 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-d6575ae7-3d09-4117-a37e-269bd562c4c1 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:56:46.667906 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-d6575ae7-3d09-4117-a37e-269bd562c4c1 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] [instance: 52848078-62a1-484f-813c-7b3352cb3851] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:56:46.676440 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-d6575ae7-3d09-4117-a37e-269bd562c4c1 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:56:46.677457 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-d6575ae7-3d09-4117-a37e-269bd562c4c1 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:56:46.678869 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-d6575ae7-3d09-4117-a37e-269bd562c4c1 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:56:46.679486 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-d6575ae7-3d09-4117-a37e-269bd562c4c1 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:56:46.882092 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-b451a339-7183-4b32-9af4-25b0acfada80 tempest-VolumesActionsTest-1665182479 tempest-VolumesActionsTest-1665182479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd273630a84d41f49dcf8208c618f256', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a407f0bf436c4987b9eb2e59c46d82a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:56:46.891229 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-b451a339-7183-4b32-9af4-25b0acfada80 tempest-VolumesActionsTest-1665182479 tempest-VolumesActionsTest-1665182479-project] 10.222.0.20 "GET /compute/v2.1/servers/bdb608d6-12ec-4b1e-9dfb-71c341ec749e" status: 200 len: 1314 microversion: 2.1 time: 0.284899 Jul 05 20:56:46.891821 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 156/321] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:56:46 2022] GET /compute/v2.1/servers/bdb608d6-12ec-4b1e-9dfb-71c341ec749e => generated 1314 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 20:56:46.897210 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-d6575ae7-3d09-4117-a37e-269bd562c4c1 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:56:46.898757 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-1d204544-56b7-4f35-9ce2-e18430f38b89 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:56:46.899601 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG dbcounter [-] [117628] Writing DB stats nova_cell1:SELECT=100 {{(pid=117628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:56:46.900056 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-1d204544-56b7-4f35-9ce2-e18430f38b89 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] [instance: c6c3c1ea-31e8-4c65-b73d-669f337bee2f] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:56:46.906885 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-1d204544-56b7-4f35-9ce2-e18430f38b89 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:56:46.907331 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-1d204544-56b7-4f35-9ce2-e18430f38b89 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:56:46.907619 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-d6575ae7-3d09-4117-a37e-269bd562c4c1 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:56:46.908101 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-1d204544-56b7-4f35-9ce2-e18430f38b89 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:56:46.908532 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-1d204544-56b7-4f35-9ce2-e18430f38b89 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:56:46.909148 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-d6575ae7-3d09-4117-a37e-269bd562c4c1 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:56:46.910292 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-d6575ae7-3d09-4117-a37e-269bd562c4c1 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] 10.222.0.20 "GET /compute/v2.1/servers/52848078-62a1-484f-813c-7b3352cb3851" status: 200 len: 1719 microversion: 2.20 time: 0.248369 Jul 05 20:56:46.911043 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 166/322] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 5 20:56:46 2022] GET /compute/v2.1/servers/52848078-62a1-484f-813c-7b3352cb3851 => generated 1719 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 05 20:56:46.915410 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [req-a03932d7-cdb4-4fb5-98e3-796aa72fa3f6 req-818768cd-a39f-4cd1-a356-5b30f52603c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b18289e-137f-467c-96ec-cc6179f93e17", "name": "network-vif-plugged", "status": "completed", "tag": "6b603e35-d2c5-47fc-83a0-12c2780e086f"}]} {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 20:56:46.924703 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [req-a03932d7-cdb4-4fb5-98e3-796aa72fa3f6 req-818768cd-a39f-4cd1-a356-5b30f52603c9 service nova] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:56:46.925095 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [req-a03932d7-cdb4-4fb5-98e3-796aa72fa3f6 req-818768cd-a39f-4cd1-a356-5b30f52603c9 service nova] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:56:46.936143 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.compute.server_external_events [req-a03932d7-cdb4-4fb5-98e3-796aa72fa3f6 req-818768cd-a39f-4cd1-a356-5b30f52603c9 service nova] Creating event network-vif-plugged:6b603e35-d2c5-47fc-83a0-12c2780e086f for instance 7b18289e-137f-467c-96ec-cc6179f93e17 on hv-cinder-79760 Jul 05 20:56:46.941305 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [req-a03932d7-cdb4-4fb5-98e3-796aa72fa3f6 req-818768cd-a39f-4cd1-a356-5b30f52603c9 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029112 Jul 05 20:56:46.942048 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 167/323] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 5 20:56:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 20:56:47.041338 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-1d204544-56b7-4f35-9ce2-e18430f38b89 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd152763a64794301b21587ab2b395bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc6d47f96d17471d94367bc8f8a3e3f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:56:47.049608 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-1d204544-56b7-4f35-9ce2-e18430f38b89 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] 10.222.0.20 "GET /compute/v2.1/servers/c6c3c1ea-31e8-4c65-b73d-669f337bee2f" status: 200 len: 1370 microversion: 2.1 time: 0.156464 Jul 05 20:56:47.050160 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 157/324] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:56:46 2022] GET /compute/v2.1/servers/c6c3c1ea-31e8-4c65-b73d-669f337bee2f => generated 1370 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 20:56:47.613761 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-afdfa040-052b-4d31-a150-71fef80218ea tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:56:47.614484 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-afdfa040-052b-4d31-a150-71fef80218ea tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] [instance: f236112c-4649-478b-a626-b84f8ff1bfe9] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:56:47.620734 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-afdfa040-052b-4d31-a150-71fef80218ea tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:56:47.621214 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-afdfa040-052b-4d31-a150-71fef80218ea tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:56:47.622002 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-afdfa040-052b-4d31-a150-71fef80218ea tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:56:47.622441 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-afdfa040-052b-4d31-a150-71fef80218ea tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:56:47.631031 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-8c60fc5e-4021-4afc-924f-1172d54cded5 tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:56:47.631742 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-8c60fc5e-4021-4afc-924f-1172d54cded5 tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] [instance: 7b18289e-137f-467c-96ec-cc6179f93e17] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:56:47.638733 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-8c60fc5e-4021-4afc-924f-1172d54cded5 tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:56:47.639187 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-8c60fc5e-4021-4afc-924f-1172d54cded5 tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:56:47.639949 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-8c60fc5e-4021-4afc-924f-1172d54cded5 tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:56:47.640374 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-8c60fc5e-4021-4afc-924f-1172d54cded5 tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:56:47.644409 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG dbcounter [-] [117627] Writing DB stats nova_cell1:SELECT=100 {{(pid=117627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:56:47.838083 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-afdfa040-052b-4d31-a150-71fef80218ea tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eac41ce3f04450b840cff305ec1a5ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47e1ad014d542f98f6b24c8a504d166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:56:47.848567 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-afdfa040-052b-4d31-a150-71fef80218ea tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] 10.222.0.20 "GET /compute/v2.1/servers/f236112c-4649-478b-a626-b84f8ff1bfe9" status: 200 len: 1722 microversion: 2.1 time: 0.240575 Jul 05 20:56:47.849191 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 168/325] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:56:47 2022] GET /compute/v2.1/servers/f236112c-4649-478b-a626-b84f8ff1bfe9 => generated 1722 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 20:56:47.885110 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-8c60fc5e-4021-4afc-924f-1172d54cded5 tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a4b471d14044069a5969e8bc6ca4f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3429e99ac2a94266b152e053bc6a0006', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:56:47.893878 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-8c60fc5e-4021-4afc-924f-1172d54cded5 tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] 10.222.0.20 "GET /compute/v2.1/servers/7b18289e-137f-467c-96ec-cc6179f93e17" status: 200 len: 1258 microversion: 2.1 time: 0.266623 Jul 05 20:56:47.894445 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 158/326] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:56:47 2022] GET /compute/v2.1/servers/7b18289e-137f-467c-96ec-cc6179f93e17 => generated 1258 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 20:56:47.908484 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-15b74af4-e493-42dc-837f-a13a4eaa7e81 tempest-VolumesActionsTest-1665182479 tempest-VolumesActionsTest-1665182479-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:56:47.911259 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-15b74af4-e493-42dc-837f-a13a4eaa7e81 tempest-VolumesActionsTest-1665182479 tempest-VolumesActionsTest-1665182479-project] [instance: bdb608d6-12ec-4b1e-9dfb-71c341ec749e] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:56:47.917437 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-15b74af4-e493-42dc-837f-a13a4eaa7e81 tempest-VolumesActionsTest-1665182479 tempest-VolumesActionsTest-1665182479-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:56:47.917880 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-15b74af4-e493-42dc-837f-a13a4eaa7e81 tempest-VolumesActionsTest-1665182479 tempest-VolumesActionsTest-1665182479-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:56:47.918835 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-15b74af4-e493-42dc-837f-a13a4eaa7e81 tempest-VolumesActionsTest-1665182479 tempest-VolumesActionsTest-1665182479-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:56:47.919268 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-15b74af4-e493-42dc-837f-a13a4eaa7e81 tempest-VolumesActionsTest-1665182479 tempest-VolumesActionsTest-1665182479-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:56:47.937027 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-b9d9da9d-7103-401d-bbf3-f1e50959179c tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:56:47.937902 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-b9d9da9d-7103-401d-bbf3-f1e50959179c tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] [instance: 52848078-62a1-484f-813c-7b3352cb3851] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:56:47.943904 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-b9d9da9d-7103-401d-bbf3-f1e50959179c tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:56:47.944351 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-b9d9da9d-7103-401d-bbf3-f1e50959179c tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:56:47.945226 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-b9d9da9d-7103-401d-bbf3-f1e50959179c tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:56:47.945663 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-b9d9da9d-7103-401d-bbf3-f1e50959179c tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:56:48.138218 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-15b74af4-e493-42dc-837f-a13a4eaa7e81 tempest-VolumesActionsTest-1665182479 tempest-VolumesActionsTest-1665182479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd273630a84d41f49dcf8208c618f256', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a407f0bf436c4987b9eb2e59c46d82a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:56:48.145340 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-b9d9da9d-7103-401d-bbf3-f1e50959179c tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:56:48.145712 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-15b74af4-e493-42dc-837f-a13a4eaa7e81 tempest-VolumesActionsTest-1665182479 tempest-VolumesActionsTest-1665182479-project] 10.222.0.20 "GET /compute/v2.1/servers/bdb608d6-12ec-4b1e-9dfb-71c341ec749e" status: 200 len: 1314 microversion: 2.1 time: 0.241350 Jul 05 20:56:48.146280 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 169/327] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:56:47 2022] GET /compute/v2.1/servers/bdb608d6-12ec-4b1e-9dfb-71c341ec749e => generated 1314 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 20:56:48.151025 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-ee63107d-3620-4300-b58a-bab74fda0160 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:56:48.151613 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-ee63107d-3620-4300-b58a-bab74fda0160 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] [instance: c6c3c1ea-31e8-4c65-b73d-669f337bee2f] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:56:48.155718 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-b9d9da9d-7103-401d-bbf3-f1e50959179c tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:56:48.157894 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-b9d9da9d-7103-401d-bbf3-f1e50959179c tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:56:48.158086 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-ee63107d-3620-4300-b58a-bab74fda0160 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:56:48.158426 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-ee63107d-3620-4300-b58a-bab74fda0160 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:56:48.159375 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-ee63107d-3620-4300-b58a-bab74fda0160 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:56:48.159506 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-b9d9da9d-7103-401d-bbf3-f1e50959179c tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] 10.222.0.20 "GET /compute/v2.1/servers/52848078-62a1-484f-813c-7b3352cb3851" status: 200 len: 1719 microversion: 2.20 time: 0.230827 Jul 05 20:56:48.160072 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 159/328] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 5 20:56:47 2022] GET /compute/v2.1/servers/52848078-62a1-484f-813c-7b3352cb3851 => generated 1719 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 20:56:48.160218 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-ee63107d-3620-4300-b58a-bab74fda0160 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:56:48.300835 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-ee63107d-3620-4300-b58a-bab74fda0160 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd152763a64794301b21587ab2b395bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc6d47f96d17471d94367bc8f8a3e3f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:56:48.308786 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-ee63107d-3620-4300-b58a-bab74fda0160 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] 10.222.0.20 "GET /compute/v2.1/servers/c6c3c1ea-31e8-4c65-b73d-669f337bee2f" status: 200 len: 1370 microversion: 2.1 time: 0.161488 Jul 05 20:56:48.309398 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 170/329] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:56:48 2022] GET /compute/v2.1/servers/c6c3c1ea-31e8-4c65-b73d-669f337bee2f => generated 1370 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 20:56:48.865927 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-14d31579-53eb-4134-b582-b891f43bd4fc tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:56:48.866538 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-14d31579-53eb-4134-b582-b891f43bd4fc tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] [instance: f236112c-4649-478b-a626-b84f8ff1bfe9] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:56:48.874689 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-14d31579-53eb-4134-b582-b891f43bd4fc tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:56:48.875264 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-14d31579-53eb-4134-b582-b891f43bd4fc tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:56:48.876039 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-14d31579-53eb-4134-b582-b891f43bd4fc tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:56:48.876479 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-14d31579-53eb-4134-b582-b891f43bd4fc tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:56:48.913733 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-8e751cd1-fe8c-4165-9169-e6bc9e4d193c tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:56:48.914355 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-8e751cd1-fe8c-4165-9169-e6bc9e4d193c tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] [instance: 7b18289e-137f-467c-96ec-cc6179f93e17] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:56:48.922036 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-8e751cd1-fe8c-4165-9169-e6bc9e4d193c tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:56:48.922637 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-8e751cd1-fe8c-4165-9169-e6bc9e4d193c tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:56:48.923494 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-8e751cd1-fe8c-4165-9169-e6bc9e4d193c tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:56:48.924120 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-8e751cd1-fe8c-4165-9169-e6bc9e4d193c tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:56:49.103237 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-14d31579-53eb-4134-b582-b891f43bd4fc tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eac41ce3f04450b840cff305ec1a5ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47e1ad014d542f98f6b24c8a504d166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:56:49.113180 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-14d31579-53eb-4134-b582-b891f43bd4fc tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] 10.222.0.20 "GET /compute/v2.1/servers/f236112c-4649-478b-a626-b84f8ff1bfe9" status: 200 len: 1722 microversion: 2.1 time: 0.251025 Jul 05 20:56:49.113758 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 160/330] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:56:48 2022] GET /compute/v2.1/servers/f236112c-4649-478b-a626-b84f8ff1bfe9 => generated 1722 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 20:56:49.133461 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-8e751cd1-fe8c-4165-9169-e6bc9e4d193c tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a4b471d14044069a5969e8bc6ca4f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3429e99ac2a94266b152e053bc6a0006', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:56:49.141168 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-8e751cd1-fe8c-4165-9169-e6bc9e4d193c tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] 10.222.0.20 "GET /compute/v2.1/servers/7b18289e-137f-467c-96ec-cc6179f93e17" status: 200 len: 1258 microversion: 2.1 time: 0.233717 Jul 05 20:56:49.141737 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 171/331] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:56:48 2022] GET /compute/v2.1/servers/7b18289e-137f-467c-96ec-cc6179f93e17 => generated 1258 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 20:56:49.162795 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-383826f1-ffbd-42ae-861c-13d85f41bf4e tempest-VolumesActionsTest-1665182479 tempest-VolumesActionsTest-1665182479-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:56:49.163487 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-383826f1-ffbd-42ae-861c-13d85f41bf4e tempest-VolumesActionsTest-1665182479 tempest-VolumesActionsTest-1665182479-project] [instance: bdb608d6-12ec-4b1e-9dfb-71c341ec749e] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:56:49.169763 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-383826f1-ffbd-42ae-861c-13d85f41bf4e tempest-VolumesActionsTest-1665182479 tempest-VolumesActionsTest-1665182479-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:56:49.170211 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-383826f1-ffbd-42ae-861c-13d85f41bf4e tempest-VolumesActionsTest-1665182479 tempest-VolumesActionsTest-1665182479-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:56:49.172397 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-383826f1-ffbd-42ae-861c-13d85f41bf4e tempest-VolumesActionsTest-1665182479 tempest-VolumesActionsTest-1665182479-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:56:49.173083 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-383826f1-ffbd-42ae-861c-13d85f41bf4e tempest-VolumesActionsTest-1665182479 tempest-VolumesActionsTest-1665182479-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:56:49.178441 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-c48ce6bd-ca62-4705-9972-d9c4580f7c31 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:56:49.179365 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-c48ce6bd-ca62-4705-9972-d9c4580f7c31 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] [instance: 52848078-62a1-484f-813c-7b3352cb3851] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:56:49.187511 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG dbcounter [-] [117628] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=117628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:56:49.192136 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-c48ce6bd-ca62-4705-9972-d9c4580f7c31 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:56:49.192726 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-c48ce6bd-ca62-4705-9972-d9c4580f7c31 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:56:49.193646 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-c48ce6bd-ca62-4705-9972-d9c4580f7c31 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:56:49.194450 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-c48ce6bd-ca62-4705-9972-d9c4580f7c31 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:56:49.396497 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-383826f1-ffbd-42ae-861c-13d85f41bf4e tempest-VolumesActionsTest-1665182479 tempest-VolumesActionsTest-1665182479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd273630a84d41f49dcf8208c618f256', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a407f0bf436c4987b9eb2e59c46d82a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:56:49.404299 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-c48ce6bd-ca62-4705-9972-d9c4580f7c31 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:56:49.412542 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-383826f1-ffbd-42ae-861c-13d85f41bf4e tempest-VolumesActionsTest-1665182479 tempest-VolumesActionsTest-1665182479-project] 10.222.0.20 "GET /compute/v2.1/servers/bdb608d6-12ec-4b1e-9dfb-71c341ec749e" status: 200 len: 1314 microversion: 2.1 time: 0.253547 Jul 05 20:56:49.413151 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 161/332] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:56:49 2022] GET /compute/v2.1/servers/bdb608d6-12ec-4b1e-9dfb-71c341ec749e => generated 1314 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 20:56:49.418650 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-c48ce6bd-ca62-4705-9972-d9c4580f7c31 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:56:49.420164 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-c48ce6bd-ca62-4705-9972-d9c4580f7c31 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:56:49.421389 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-c48ce6bd-ca62-4705-9972-d9c4580f7c31 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] 10.222.0.20 "GET /compute/v2.1/servers/52848078-62a1-484f-813c-7b3352cb3851" status: 200 len: 1719 microversion: 2.20 time: 0.247522 Jul 05 20:56:49.422145 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 172/333] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 5 20:56:49 2022] GET /compute/v2.1/servers/52848078-62a1-484f-813c-7b3352cb3851 => generated 1719 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 05 20:56:49.426246 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-083f7179-1073-4412-94fb-0b3356279cd6 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:56:49.426858 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-083f7179-1073-4412-94fb-0b3356279cd6 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] [instance: c6c3c1ea-31e8-4c65-b73d-669f337bee2f] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:56:49.432980 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-083f7179-1073-4412-94fb-0b3356279cd6 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:56:49.433429 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-083f7179-1073-4412-94fb-0b3356279cd6 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:56:49.434191 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-083f7179-1073-4412-94fb-0b3356279cd6 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:56:49.434615 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-083f7179-1073-4412-94fb-0b3356279cd6 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:56:49.571188 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-083f7179-1073-4412-94fb-0b3356279cd6 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd152763a64794301b21587ab2b395bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc6d47f96d17471d94367bc8f8a3e3f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:56:49.579419 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-083f7179-1073-4412-94fb-0b3356279cd6 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] 10.222.0.20 "GET /compute/v2.1/servers/c6c3c1ea-31e8-4c65-b73d-669f337bee2f" status: 200 len: 1564 microversion: 2.1 time: 0.165316 Jul 05 20:56:49.580021 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 162/334] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:56:49 2022] GET /compute/v2.1/servers/c6c3c1ea-31e8-4c65-b73d-669f337bee2f => generated 1564 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 20:56:49.597374 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-78723aa8-5890-49a7-af02-c1622e70e302 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:56:49.597930 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-78723aa8-5890-49a7-af02-c1622e70e302 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] [instance: c6c3c1ea-31e8-4c65-b73d-669f337bee2f] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:56:49.603960 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-78723aa8-5890-49a7-af02-c1622e70e302 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:56:49.604413 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-78723aa8-5890-49a7-af02-c1622e70e302 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:56:49.605203 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-78723aa8-5890-49a7-af02-c1622e70e302 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:56:49.605646 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-78723aa8-5890-49a7-af02-c1622e70e302 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:56:49.687037 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-78723aa8-5890-49a7-af02-c1622e70e302 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] 10.222.0.20 "GET /compute/v2.1/servers/c6c3c1ea-31e8-4c65-b73d-669f337bee2f/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.094434 Jul 05 20:56:49.687711 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 173/335] 10.222.0.20 () {58 vars in 1274 bytes} [Tue Jul 5 20:56:49 2022] GET /compute/v2.1/servers/c6c3c1ea-31e8-4c65-b73d-669f337bee2f/os-interface => generated 284 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 20:56:50.129981 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-581616f8-1654-4b6b-b6ff-77c8a3f48c3c tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:56:50.130575 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-581616f8-1654-4b6b-b6ff-77c8a3f48c3c tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] [instance: f236112c-4649-478b-a626-b84f8ff1bfe9] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:56:50.132845 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG dbcounter [-] [117627] Writing DB stats nova_cell0:SELECT=2 {{(pid=117627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:56:50.133526 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG dbcounter [-] [117627] Writing DB stats nova_cell0:SELECT=6 {{(pid=117627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:56:50.142163 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-581616f8-1654-4b6b-b6ff-77c8a3f48c3c tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:56:50.142608 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-581616f8-1654-4b6b-b6ff-77c8a3f48c3c tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:56:50.143379 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-581616f8-1654-4b6b-b6ff-77c8a3f48c3c tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:56:50.143806 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-581616f8-1654-4b6b-b6ff-77c8a3f48c3c tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:56:50.159325 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-cc34ba69-3ec5-4d79-b3c5-ea09c4773e63 tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:56:50.160533 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-cc34ba69-3ec5-4d79-b3c5-ea09c4773e63 tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] [instance: 7b18289e-137f-467c-96ec-cc6179f93e17] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:56:50.166916 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-cc34ba69-3ec5-4d79-b3c5-ea09c4773e63 tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:56:50.167621 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-cc34ba69-3ec5-4d79-b3c5-ea09c4773e63 tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:56:50.168558 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-cc34ba69-3ec5-4d79-b3c5-ea09c4773e63 tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:56:50.169173 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-cc34ba69-3ec5-4d79-b3c5-ea09c4773e63 tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:56:50.304251 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG dbcounter [-] [117628] Writing DB stats nova_cell0:SELECT=6 {{(pid=117628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:56:50.512703 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-581616f8-1654-4b6b-b6ff-77c8a3f48c3c tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eac41ce3f04450b840cff305ec1a5ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47e1ad014d542f98f6b24c8a504d166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:56:50.521480 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-581616f8-1654-4b6b-b6ff-77c8a3f48c3c tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] 10.222.0.20 "GET /compute/v2.1/servers/f236112c-4649-478b-a626-b84f8ff1bfe9" status: 200 len: 1722 microversion: 2.1 time: 0.394962 Jul 05 20:56:50.521646 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-cc34ba69-3ec5-4d79-b3c5-ea09c4773e63 tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a4b471d14044069a5969e8bc6ca4f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3429e99ac2a94266b152e053bc6a0006', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:56:50.531706 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 163/336] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:56:50 2022] GET /compute/v2.1/servers/f236112c-4649-478b-a626-b84f8ff1bfe9 => generated 1722 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 20:56:50.531706 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-edadbd43-c1e6-4f4b-86c7-0bfec43de492 tempest-VolumesActionsTest-1665182479 tempest-VolumesActionsTest-1665182479-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:56:50.531706 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-edadbd43-c1e6-4f4b-86c7-0bfec43de492 tempest-VolumesActionsTest-1665182479 tempest-VolumesActionsTest-1665182479-project] [instance: bdb608d6-12ec-4b1e-9dfb-71c341ec749e] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:56:50.533892 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-edadbd43-c1e6-4f4b-86c7-0bfec43de492 tempest-VolumesActionsTest-1665182479 tempest-VolumesActionsTest-1665182479-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:56:50.534248 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-edadbd43-c1e6-4f4b-86c7-0bfec43de492 tempest-VolumesActionsTest-1665182479 tempest-VolumesActionsTest-1665182479-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:56:50.535934 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-edadbd43-c1e6-4f4b-86c7-0bfec43de492 tempest-VolumesActionsTest-1665182479 tempest-VolumesActionsTest-1665182479-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:56:50.536746 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-edadbd43-c1e6-4f4b-86c7-0bfec43de492 tempest-VolumesActionsTest-1665182479 tempest-VolumesActionsTest-1665182479-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:56:50.541833 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-cc34ba69-3ec5-4d79-b3c5-ea09c4773e63 tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] 10.222.0.20 "GET /compute/v2.1/servers/7b18289e-137f-467c-96ec-cc6179f93e17" status: 200 len: 1258 microversion: 2.1 time: 0.385249 Jul 05 20:56:50.542123 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 174/337] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:56:50 2022] GET /compute/v2.1/servers/7b18289e-137f-467c-96ec-cc6179f93e17 => generated 1258 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 20:56:50.556640 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-aae5c58a-0b4b-499d-a5dc-0e44c76cbb8b tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:56:50.557287 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-aae5c58a-0b4b-499d-a5dc-0e44c76cbb8b tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] [instance: 52848078-62a1-484f-813c-7b3352cb3851] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:56:50.564555 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-aae5c58a-0b4b-499d-a5dc-0e44c76cbb8b tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:56:50.565061 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-aae5c58a-0b4b-499d-a5dc-0e44c76cbb8b tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:56:50.565827 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-aae5c58a-0b4b-499d-a5dc-0e44c76cbb8b tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:56:50.566740 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-aae5c58a-0b4b-499d-a5dc-0e44c76cbb8b tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:56:51.092614 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-edadbd43-c1e6-4f4b-86c7-0bfec43de492 tempest-VolumesActionsTest-1665182479 tempest-VolumesActionsTest-1665182479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd273630a84d41f49dcf8208c618f256', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a407f0bf436c4987b9eb2e59c46d82a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:56:51.099657 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-aae5c58a-0b4b-499d-a5dc-0e44c76cbb8b tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:56:51.100797 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-edadbd43-c1e6-4f4b-86c7-0bfec43de492 tempest-VolumesActionsTest-1665182479 tempest-VolumesActionsTest-1665182479-project] 10.222.0.20 "GET /compute/v2.1/servers/bdb608d6-12ec-4b1e-9dfb-71c341ec749e" status: 200 len: 1314 microversion: 2.1 time: 0.577950 Jul 05 20:56:51.112560 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 164/338] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:56:50 2022] GET /compute/v2.1/servers/bdb608d6-12ec-4b1e-9dfb-71c341ec749e => generated 1314 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 20:56:51.112560 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [req-c0ddc69e-50d5-4549-b8dd-7eb1c631d578 req-07262263-5d27-4004-9f5d-5988eca8dfd6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bdb608d6-12ec-4b1e-9dfb-71c341ec749e", "name": "network-vif-plugged", "status": "completed", "tag": "0b46cd99-b04f-4b5c-8249-0fb811d094e0"}]} {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 20:56:51.116148 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [req-c0ddc69e-50d5-4549-b8dd-7eb1c631d578 req-07262263-5d27-4004-9f5d-5988eca8dfd6 service nova] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:56:51.116589 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [req-c0ddc69e-50d5-4549-b8dd-7eb1c631d578 req-07262263-5d27-4004-9f5d-5988eca8dfd6 service nova] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:56:51.118892 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-aae5c58a-0b4b-499d-a5dc-0e44c76cbb8b tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:56:51.120786 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-aae5c58a-0b4b-499d-a5dc-0e44c76cbb8b tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:56:51.122340 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-aae5c58a-0b4b-499d-a5dc-0e44c76cbb8b tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] 10.222.0.20 "GET /compute/v2.1/servers/52848078-62a1-484f-813c-7b3352cb3851" status: 200 len: 1740 microversion: 2.20 time: 0.578961 Jul 05 20:56:51.123182 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 175/339] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 5 20:56:50 2022] GET /compute/v2.1/servers/52848078-62a1-484f-813c-7b3352cb3851 => generated 1740 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 20:56:51.130239 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.compute.server_external_events [req-c0ddc69e-50d5-4549-b8dd-7eb1c631d578 req-07262263-5d27-4004-9f5d-5988eca8dfd6 service nova] Creating event network-vif-plugged:0b46cd99-b04f-4b5c-8249-0fb811d094e0 for instance bdb608d6-12ec-4b1e-9dfb-71c341ec749e on hv-cinder-79760 Jul 05 20:56:51.137110 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [req-c0ddc69e-50d5-4549-b8dd-7eb1c631d578 req-07262263-5d27-4004-9f5d-5988eca8dfd6 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032631 Jul 05 20:56:51.137594 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 165/340] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 5 20:56:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 20:56:51.251942 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [req-c43e222c-c0d1-4eea-b870-30a715302108 req-ddfb3405-fa58-4360-86b5-98a9e93eb6aa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c6c3c1ea-31e8-4c65-b73d-669f337bee2f", "tag": "895e5d50-4373-406a-8f11-70a9e025443e"}]} {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 20:56:51.261362 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [req-c43e222c-c0d1-4eea-b870-30a715302108 req-ddfb3405-fa58-4360-86b5-98a9e93eb6aa service nova] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:56:51.262080 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [req-c43e222c-c0d1-4eea-b870-30a715302108 req-ddfb3405-fa58-4360-86b5-98a9e93eb6aa service nova] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:56:51.277176 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.compute.server_external_events [req-c43e222c-c0d1-4eea-b870-30a715302108 req-ddfb3405-fa58-4360-86b5-98a9e93eb6aa service nova] Creating event network-changed:895e5d50-4373-406a-8f11-70a9e025443e for instance c6c3c1ea-31e8-4c65-b73d-669f337bee2f on hv-cinder-79760 Jul 05 20:56:51.284221 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [req-c43e222c-c0d1-4eea-b870-30a715302108 req-ddfb3405-fa58-4360-86b5-98a9e93eb6aa service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036383 Jul 05 20:56:51.285248 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 176/341] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 5 20:56:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 20:56:51.540113 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-d2912a61-ab00-4059-8ecf-afafe84b9320 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:56:51.541422 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-d2912a61-ab00-4059-8ecf-afafe84b9320 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] [instance: f236112c-4649-478b-a626-b84f8ff1bfe9] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:56:51.549467 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-d2912a61-ab00-4059-8ecf-afafe84b9320 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:56:51.550049 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-d2912a61-ab00-4059-8ecf-afafe84b9320 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:56:51.550854 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-d2912a61-ab00-4059-8ecf-afafe84b9320 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:56:51.551317 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-d2912a61-ab00-4059-8ecf-afafe84b9320 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:56:51.558815 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-2ee1d104-d0cc-4fe9-9468-c59048b716b2 tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:56:51.559523 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-2ee1d104-d0cc-4fe9-9468-c59048b716b2 tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] [instance: 7b18289e-137f-467c-96ec-cc6179f93e17] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:56:51.566055 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-2ee1d104-d0cc-4fe9-9468-c59048b716b2 tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:56:51.566501 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-2ee1d104-d0cc-4fe9-9468-c59048b716b2 tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:56:51.567266 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-2ee1d104-d0cc-4fe9-9468-c59048b716b2 tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:56:51.567699 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-2ee1d104-d0cc-4fe9-9468-c59048b716b2 tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:56:51.769970 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-d2912a61-ab00-4059-8ecf-afafe84b9320 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eac41ce3f04450b840cff305ec1a5ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47e1ad014d542f98f6b24c8a504d166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:56:51.773123 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-2ee1d104-d0cc-4fe9-9468-c59048b716b2 tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a4b471d14044069a5969e8bc6ca4f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3429e99ac2a94266b152e053bc6a0006', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:56:51.789492 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-2ee1d104-d0cc-4fe9-9468-c59048b716b2 tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] 10.222.0.20 "GET /compute/v2.1/servers/7b18289e-137f-467c-96ec-cc6179f93e17" status: 200 len: 1442 microversion: 2.1 time: 0.234675 Jul 05 20:56:51.790421 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-d2912a61-ab00-4059-8ecf-afafe84b9320 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] 10.222.0.20 "GET /compute/v2.1/servers/f236112c-4649-478b-a626-b84f8ff1bfe9" status: 200 len: 1722 microversion: 2.1 time: 0.254488 Jul 05 20:56:51.801179 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 166/342] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:56:51 2022] GET /compute/v2.1/servers/f236112c-4649-478b-a626-b84f8ff1bfe9 => generated 1722 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 20:56:51.801407 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 177/343] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:56:51 2022] GET /compute/v2.1/servers/7b18289e-137f-467c-96ec-cc6179f93e17 => generated 1442 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 20:56:51.816966 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-c8ada8a6-4059-4e95-aa8d-b6d0cd11342e tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:56:51.819666 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-c8ada8a6-4059-4e95-aa8d-b6d0cd11342e tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] [instance: 7b18289e-137f-467c-96ec-cc6179f93e17] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:56:51.824050 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-c8ada8a6-4059-4e95-aa8d-b6d0cd11342e tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:56:51.824496 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-c8ada8a6-4059-4e95-aa8d-b6d0cd11342e tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:56:51.825342 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-c8ada8a6-4059-4e95-aa8d-b6d0cd11342e tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:56:51.825732 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-c8ada8a6-4059-4e95-aa8d-b6d0cd11342e tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:56:52.017525 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-c8ada8a6-4059-4e95-aa8d-b6d0cd11342e tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a4b471d14044069a5969e8bc6ca4f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3429e99ac2a94266b152e053bc6a0006', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:56:52.026240 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-c8ada8a6-4059-4e95-aa8d-b6d0cd11342e tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] 10.222.0.20 "GET /compute/v2.1/servers/7b18289e-137f-467c-96ec-cc6179f93e17" status: 200 len: 1442 microversion: 2.1 time: 0.213268 Jul 05 20:56:52.026815 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 167/344] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:56:51 2022] GET /compute/v2.1/servers/7b18289e-137f-467c-96ec-cc6179f93e17 => generated 1442 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 20:56:52.119949 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-44ea7ee4-6eee-48e7-8eb8-d71bb0bebfe4 tempest-VolumesActionsTest-1665182479 tempest-VolumesActionsTest-1665182479-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:56:52.120749 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-44ea7ee4-6eee-48e7-8eb8-d71bb0bebfe4 tempest-VolumesActionsTest-1665182479 tempest-VolumesActionsTest-1665182479-project] [instance: bdb608d6-12ec-4b1e-9dfb-71c341ec749e] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:56:52.128245 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-44ea7ee4-6eee-48e7-8eb8-d71bb0bebfe4 tempest-VolumesActionsTest-1665182479 tempest-VolumesActionsTest-1665182479-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:56:52.128691 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-44ea7ee4-6eee-48e7-8eb8-d71bb0bebfe4 tempest-VolumesActionsTest-1665182479 tempest-VolumesActionsTest-1665182479-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:56:52.129657 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-44ea7ee4-6eee-48e7-8eb8-d71bb0bebfe4 tempest-VolumesActionsTest-1665182479 tempest-VolumesActionsTest-1665182479-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:56:52.130346 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-44ea7ee4-6eee-48e7-8eb8-d71bb0bebfe4 tempest-VolumesActionsTest-1665182479 tempest-VolumesActionsTest-1665182479-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:56:52.142498 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-c2e69df0-8517-476f-9e44-aef064f68c72 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:56:52.143404 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-c2e69df0-8517-476f-9e44-aef064f68c72 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] [instance: 52848078-62a1-484f-813c-7b3352cb3851] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:56:52.150059 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-c2e69df0-8517-476f-9e44-aef064f68c72 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:56:52.150768 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-c2e69df0-8517-476f-9e44-aef064f68c72 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:56:52.151693 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-c2e69df0-8517-476f-9e44-aef064f68c72 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:56:52.152282 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-c2e69df0-8517-476f-9e44-aef064f68c72 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:56:52.413395 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-44ea7ee4-6eee-48e7-8eb8-d71bb0bebfe4 tempest-VolumesActionsTest-1665182479 tempest-VolumesActionsTest-1665182479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd273630a84d41f49dcf8208c618f256', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a407f0bf436c4987b9eb2e59c46d82a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:56:52.416550 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-c2e69df0-8517-476f-9e44-aef064f68c72 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:56:52.422117 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-44ea7ee4-6eee-48e7-8eb8-d71bb0bebfe4 tempest-VolumesActionsTest-1665182479 tempest-VolumesActionsTest-1665182479-project] 10.222.0.20 "GET /compute/v2.1/servers/bdb608d6-12ec-4b1e-9dfb-71c341ec749e" status: 200 len: 1314 microversion: 2.1 time: 0.306421 Jul 05 20:56:52.423599 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 178/345] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:56:52 2022] GET /compute/v2.1/servers/bdb608d6-12ec-4b1e-9dfb-71c341ec749e => generated 1314 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 20:56:52.434458 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-c2e69df0-8517-476f-9e44-aef064f68c72 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:56:52.436784 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-c2e69df0-8517-476f-9e44-aef064f68c72 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:56:52.438022 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-c2e69df0-8517-476f-9e44-aef064f68c72 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] 10.222.0.20 "GET /compute/v2.1/servers/52848078-62a1-484f-813c-7b3352cb3851" status: 200 len: 1740 microversion: 2.20 time: 0.299975 Jul 05 20:56:52.438569 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 168/346] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 5 20:56:52 2022] GET /compute/v2.1/servers/52848078-62a1-484f-813c-7b3352cb3851 => generated 1740 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 05 20:56:52.821999 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-b3285209-7713-4821-ab90-fe35580edd1d tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:56:52.822845 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-b3285209-7713-4821-ab90-fe35580edd1d tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] [instance: f236112c-4649-478b-a626-b84f8ff1bfe9] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:56:52.832083 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-b3285209-7713-4821-ab90-fe35580edd1d tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:56:52.832700 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-b3285209-7713-4821-ab90-fe35580edd1d tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:56:52.834252 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-b3285209-7713-4821-ab90-fe35580edd1d tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:56:52.834690 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-b3285209-7713-4821-ab90-fe35580edd1d tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:56:53.049193 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-b3285209-7713-4821-ab90-fe35580edd1d tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eac41ce3f04450b840cff305ec1a5ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47e1ad014d542f98f6b24c8a504d166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:56:53.057383 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-b3285209-7713-4821-ab90-fe35580edd1d tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] 10.222.0.20 "GET /compute/v2.1/servers/f236112c-4649-478b-a626-b84f8ff1bfe9" status: 200 len: 1722 microversion: 2.1 time: 0.243400 Jul 05 20:56:53.068367 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 179/347] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:56:52 2022] GET /compute/v2.1/servers/f236112c-4649-478b-a626-b84f8ff1bfe9 => generated 1722 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 20:56:53.439890 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-52b5f11a-075b-4ce1-90f6-7452d389d42e tempest-VolumesActionsTest-1665182479 tempest-VolumesActionsTest-1665182479-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:56:53.440532 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-52b5f11a-075b-4ce1-90f6-7452d389d42e tempest-VolumesActionsTest-1665182479 tempest-VolumesActionsTest-1665182479-project] [instance: bdb608d6-12ec-4b1e-9dfb-71c341ec749e] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:56:53.447386 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-52b5f11a-075b-4ce1-90f6-7452d389d42e tempest-VolumesActionsTest-1665182479 tempest-VolumesActionsTest-1665182479-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:56:53.447834 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-52b5f11a-075b-4ce1-90f6-7452d389d42e tempest-VolumesActionsTest-1665182479 tempest-VolumesActionsTest-1665182479-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:56:53.448594 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-52b5f11a-075b-4ce1-90f6-7452d389d42e tempest-VolumesActionsTest-1665182479 tempest-VolumesActionsTest-1665182479-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:56:53.449056 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-52b5f11a-075b-4ce1-90f6-7452d389d42e tempest-VolumesActionsTest-1665182479 tempest-VolumesActionsTest-1665182479-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:56:53.456363 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-51a2b182-7689-496c-ad92-f1ac5a814f5b tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:56:53.456993 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-51a2b182-7689-496c-ad92-f1ac5a814f5b tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] [instance: 52848078-62a1-484f-813c-7b3352cb3851] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:56:53.463963 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-51a2b182-7689-496c-ad92-f1ac5a814f5b tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:56:53.464410 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-51a2b182-7689-496c-ad92-f1ac5a814f5b tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:56:53.465444 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-51a2b182-7689-496c-ad92-f1ac5a814f5b tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:56:53.465768 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-51a2b182-7689-496c-ad92-f1ac5a814f5b tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:56:53.648318 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-51a2b182-7689-496c-ad92-f1ac5a814f5b tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:56:53.659087 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-51a2b182-7689-496c-ad92-f1ac5a814f5b tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:56:53.661518 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-51a2b182-7689-496c-ad92-f1ac5a814f5b tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:56:53.662724 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-51a2b182-7689-496c-ad92-f1ac5a814f5b tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] 10.222.0.20 "GET /compute/v2.1/servers/52848078-62a1-484f-813c-7b3352cb3851" status: 200 len: 1740 microversion: 2.20 time: 0.210145 Jul 05 20:56:53.663284 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 180/348] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 5 20:56:53 2022] GET /compute/v2.1/servers/52848078-62a1-484f-813c-7b3352cb3851 => generated 1740 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 05 20:56:53.674565 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-52b5f11a-075b-4ce1-90f6-7452d389d42e tempest-VolumesActionsTest-1665182479 tempest-VolumesActionsTest-1665182479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd273630a84d41f49dcf8208c618f256', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a407f0bf436c4987b9eb2e59c46d82a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:56:53.682212 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-52b5f11a-075b-4ce1-90f6-7452d389d42e tempest-VolumesActionsTest-1665182479 tempest-VolumesActionsTest-1665182479-project] 10.222.0.20 "GET /compute/v2.1/servers/bdb608d6-12ec-4b1e-9dfb-71c341ec749e" status: 200 len: 1498 microversion: 2.1 time: 0.246922 Jul 05 20:56:53.682768 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 169/349] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:56:53 2022] GET /compute/v2.1/servers/bdb608d6-12ec-4b1e-9dfb-71c341ec749e => generated 1498 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 20:56:53.976341 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [req-ae66b59c-afc3-4640-96ec-03b3e7f851ea req-274fdb8b-65b8-4dee-889e-508217efb9fa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7b18289e-137f-467c-96ec-cc6179f93e17", "tag": "6b603e35-d2c5-47fc-83a0-12c2780e086f"}]} {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 20:56:53.985185 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [req-ae66b59c-afc3-4640-96ec-03b3e7f851ea req-274fdb8b-65b8-4dee-889e-508217efb9fa service nova] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:56:53.985677 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [req-ae66b59c-afc3-4640-96ec-03b3e7f851ea req-274fdb8b-65b8-4dee-889e-508217efb9fa service nova] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:56:53.998661 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.compute.server_external_events [req-ae66b59c-afc3-4640-96ec-03b3e7f851ea req-274fdb8b-65b8-4dee-889e-508217efb9fa service nova] Creating event network-changed:6b603e35-d2c5-47fc-83a0-12c2780e086f for instance 7b18289e-137f-467c-96ec-cc6179f93e17 on hv-cinder-79760 Jul 05 20:56:54.004140 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [req-ae66b59c-afc3-4640-96ec-03b3e7f851ea req-274fdb8b-65b8-4dee-889e-508217efb9fa service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031103 Jul 05 20:56:54.004849 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 181/350] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 5 20:56:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 20:56:54.075557 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-79fd5624-f1a5-4174-83ce-d62ab09ac6ce tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:56:54.077556 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-79fd5624-f1a5-4174-83ce-d62ab09ac6ce tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] [instance: f236112c-4649-478b-a626-b84f8ff1bfe9] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:56:54.084203 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-79fd5624-f1a5-4174-83ce-d62ab09ac6ce tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:56:54.084798 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-79fd5624-f1a5-4174-83ce-d62ab09ac6ce tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:56:54.085970 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-79fd5624-f1a5-4174-83ce-d62ab09ac6ce tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:56:54.086744 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-79fd5624-f1a5-4174-83ce-d62ab09ac6ce tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:56:54.310394 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-79fd5624-f1a5-4174-83ce-d62ab09ac6ce tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eac41ce3f04450b840cff305ec1a5ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47e1ad014d542f98f6b24c8a504d166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:56:54.320046 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-79fd5624-f1a5-4174-83ce-d62ab09ac6ce tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] 10.222.0.20 "GET /compute/v2.1/servers/f236112c-4649-478b-a626-b84f8ff1bfe9" status: 200 len: 1722 microversion: 2.1 time: 0.248344 Jul 05 20:56:54.321261 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 170/351] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:56:54 2022] GET /compute/v2.1/servers/f236112c-4649-478b-a626-b84f8ff1bfe9 => generated 1722 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 20:56:54.370322 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-d3863a3a-569c-4ee5-b05c-efb035829f70 tempest-VolumesActionsTest-1665182479 tempest-VolumesActionsTest-1665182479-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:56:54.370903 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-d3863a3a-569c-4ee5-b05c-efb035829f70 tempest-VolumesActionsTest-1665182479 tempest-VolumesActionsTest-1665182479-project] [instance: bdb608d6-12ec-4b1e-9dfb-71c341ec749e] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:56:54.379277 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-d3863a3a-569c-4ee5-b05c-efb035829f70 tempest-VolumesActionsTest-1665182479 tempest-VolumesActionsTest-1665182479-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:56:54.379727 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-d3863a3a-569c-4ee5-b05c-efb035829f70 tempest-VolumesActionsTest-1665182479 tempest-VolumesActionsTest-1665182479-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:56:54.380498 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-d3863a3a-569c-4ee5-b05c-efb035829f70 tempest-VolumesActionsTest-1665182479 tempest-VolumesActionsTest-1665182479-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:56:54.380977 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-d3863a3a-569c-4ee5-b05c-efb035829f70 tempest-VolumesActionsTest-1665182479 tempest-VolumesActionsTest-1665182479-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:56:54.412593 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-d3863a3a-569c-4ee5-b05c-efb035829f70 tempest-VolumesActionsTest-1665182479 tempest-VolumesActionsTest-1665182479-project] [instance: bdb608d6-12ec-4b1e-9dfb-71c341ec749e] Going to try to terminate instance {{(pid=117628) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 05 20:56:54.541117 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-d3863a3a-569c-4ee5-b05c-efb035829f70 tempest-VolumesActionsTest-1665182479 tempest-VolumesActionsTest-1665182479-project] 10.222.0.20 "DELETE /compute/v2.1/servers/bdb608d6-12ec-4b1e-9dfb-71c341ec749e" status: 204 len: 0 microversion: 2.1 time: 0.178224 Jul 05 20:56:54.542519 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 182/352] 10.222.0.20 () {58 vars in 1238 bytes} [Tue Jul 5 20:56:54 2022] DELETE /compute/v2.1/servers/bdb608d6-12ec-4b1e-9dfb-71c341ec749e => generated 0 bytes in 181 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 05 20:56:54.551177 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-db25b923-ad73-4a49-83d1-fe92ae6275de tempest-VolumesActionsTest-1665182479 tempest-VolumesActionsTest-1665182479-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:56:54.552218 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-db25b923-ad73-4a49-83d1-fe92ae6275de tempest-VolumesActionsTest-1665182479 tempest-VolumesActionsTest-1665182479-project] [instance: bdb608d6-12ec-4b1e-9dfb-71c341ec749e] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:56:54.560367 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-db25b923-ad73-4a49-83d1-fe92ae6275de tempest-VolumesActionsTest-1665182479 tempest-VolumesActionsTest-1665182479-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:56:54.561930 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-db25b923-ad73-4a49-83d1-fe92ae6275de tempest-VolumesActionsTest-1665182479 tempest-VolumesActionsTest-1665182479-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:56:54.562901 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-db25b923-ad73-4a49-83d1-fe92ae6275de tempest-VolumesActionsTest-1665182479 tempest-VolumesActionsTest-1665182479-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:56:54.563510 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-db25b923-ad73-4a49-83d1-fe92ae6275de tempest-VolumesActionsTest-1665182479 tempest-VolumesActionsTest-1665182479-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:56:54.683150 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-837f0370-7b2b-4b3d-97b6-d85f824ef5a6 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:56:54.684495 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-837f0370-7b2b-4b3d-97b6-d85f824ef5a6 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] [instance: 52848078-62a1-484f-813c-7b3352cb3851] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:56:54.693804 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-837f0370-7b2b-4b3d-97b6-d85f824ef5a6 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:56:54.694474 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-837f0370-7b2b-4b3d-97b6-d85f824ef5a6 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:56:54.696186 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-837f0370-7b2b-4b3d-97b6-d85f824ef5a6 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:56:54.696974 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-837f0370-7b2b-4b3d-97b6-d85f824ef5a6 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:56:54.822736 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-db25b923-ad73-4a49-83d1-fe92ae6275de tempest-VolumesActionsTest-1665182479 tempest-VolumesActionsTest-1665182479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd273630a84d41f49dcf8208c618f256', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a407f0bf436c4987b9eb2e59c46d82a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:56:54.841853 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-db25b923-ad73-4a49-83d1-fe92ae6275de tempest-VolumesActionsTest-1665182479 tempest-VolumesActionsTest-1665182479-project] 10.222.0.20 "GET /compute/v2.1/servers/bdb608d6-12ec-4b1e-9dfb-71c341ec749e" status: 200 len: 1504 microversion: 2.1 time: 0.294820 Jul 05 20:56:54.843348 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 171/353] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:56:54 2022] GET /compute/v2.1/servers/bdb608d6-12ec-4b1e-9dfb-71c341ec749e => generated 1504 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 20:56:54.890960 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-837f0370-7b2b-4b3d-97b6-d85f824ef5a6 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:56:54.900430 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-837f0370-7b2b-4b3d-97b6-d85f824ef5a6 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:56:54.902260 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-837f0370-7b2b-4b3d-97b6-d85f824ef5a6 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:56:54.903522 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-837f0370-7b2b-4b3d-97b6-d85f824ef5a6 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] 10.222.0.20 "GET /compute/v2.1/servers/52848078-62a1-484f-813c-7b3352cb3851" status: 200 len: 1735 microversion: 2.20 time: 0.226059 Jul 05 20:56:54.904434 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 183/354] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 5 20:56:54 2022] GET /compute/v2.1/servers/52848078-62a1-484f-813c-7b3352cb3851 => generated 1735 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 05 20:56:54.987949 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [req-5c0b78ae-8b34-4b08-9c1f-2bd481e8c850 req-63d49e2e-b895-4ee9-9849-5fb8e3836dfe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "52848078-62a1-484f-813c-7b3352cb3851", "name": "network-vif-plugged", "status": "completed", "tag": "1f543410-d13c-44b8-9d38-5417d712191c"}]} {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 20:56:54.993777 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG dbcounter [-] [117627] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=117627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:56:55.003603 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [req-5c0b78ae-8b34-4b08-9c1f-2bd481e8c850 req-63d49e2e-b895-4ee9-9849-5fb8e3836dfe service nova] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:56:55.004037 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [req-5c0b78ae-8b34-4b08-9c1f-2bd481e8c850 req-63d49e2e-b895-4ee9-9849-5fb8e3836dfe service nova] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:56:55.019844 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.compute.server_external_events [req-5c0b78ae-8b34-4b08-9c1f-2bd481e8c850 req-63d49e2e-b895-4ee9-9849-5fb8e3836dfe service nova] Creating event network-vif-plugged:1f543410-d13c-44b8-9d38-5417d712191c for instance 52848078-62a1-484f-813c-7b3352cb3851 on hv-cinder-79760 Jul 05 20:56:55.025657 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [req-5c0b78ae-8b34-4b08-9c1f-2bd481e8c850 req-63d49e2e-b895-4ee9-9849-5fb8e3836dfe service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041426 Jul 05 20:56:55.026759 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 172/355] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 5 20:56:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 20:56:55.338977 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-3d2058d5-6e2b-4b75-9614-c3fb8883a745 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:56:55.339595 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-3d2058d5-6e2b-4b75-9614-c3fb8883a745 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] [instance: f236112c-4649-478b-a626-b84f8ff1bfe9] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:56:55.346392 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-3d2058d5-6e2b-4b75-9614-c3fb8883a745 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:56:55.347194 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-3d2058d5-6e2b-4b75-9614-c3fb8883a745 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:56:55.347970 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-3d2058d5-6e2b-4b75-9614-c3fb8883a745 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:56:55.348400 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-3d2058d5-6e2b-4b75-9614-c3fb8883a745 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:56:55.351260 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG dbcounter [-] [117628] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:56:55.552403 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-3d2058d5-6e2b-4b75-9614-c3fb8883a745 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eac41ce3f04450b840cff305ec1a5ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47e1ad014d542f98f6b24c8a504d166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:56:55.564027 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-3d2058d5-6e2b-4b75-9614-c3fb8883a745 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] 10.222.0.20 "GET /compute/v2.1/servers/f236112c-4649-478b-a626-b84f8ff1bfe9" status: 200 len: 1722 microversion: 2.1 time: 0.229060 Jul 05 20:56:55.574486 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 184/356] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:56:55 2022] GET /compute/v2.1/servers/f236112c-4649-478b-a626-b84f8ff1bfe9 => generated 1722 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 20:56:55.862020 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-93414716-d0fb-45cc-880c-371924a23141 tempest-VolumesActionsTest-1665182479 tempest-VolumesActionsTest-1665182479-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:56:55.863336 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-93414716-d0fb-45cc-880c-371924a23141 tempest-VolumesActionsTest-1665182479 tempest-VolumesActionsTest-1665182479-project] [instance: bdb608d6-12ec-4b1e-9dfb-71c341ec749e] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:56:55.870930 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-93414716-d0fb-45cc-880c-371924a23141 tempest-VolumesActionsTest-1665182479 tempest-VolumesActionsTest-1665182479-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:56:55.871622 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-93414716-d0fb-45cc-880c-371924a23141 tempest-VolumesActionsTest-1665182479 tempest-VolumesActionsTest-1665182479-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:56:55.872559 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-93414716-d0fb-45cc-880c-371924a23141 tempest-VolumesActionsTest-1665182479 tempest-VolumesActionsTest-1665182479-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:56:55.873028 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-93414716-d0fb-45cc-880c-371924a23141 tempest-VolumesActionsTest-1665182479 tempest-VolumesActionsTest-1665182479-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:56:55.923099 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-95e39486-7203-471f-b0b0-17c044a8bcb3 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:56:55.923699 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-95e39486-7203-471f-b0b0-17c044a8bcb3 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] [instance: 52848078-62a1-484f-813c-7b3352cb3851] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:56:55.930121 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-95e39486-7203-471f-b0b0-17c044a8bcb3 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:56:55.930564 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-95e39486-7203-471f-b0b0-17c044a8bcb3 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:56:55.931324 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-95e39486-7203-471f-b0b0-17c044a8bcb3 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:56:55.931749 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-95e39486-7203-471f-b0b0-17c044a8bcb3 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:56:56.068266 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-93414716-d0fb-45cc-880c-371924a23141 tempest-VolumesActionsTest-1665182479 tempest-VolumesActionsTest-1665182479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd273630a84d41f49dcf8208c618f256', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a407f0bf436c4987b9eb2e59c46d82a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:56:56.076488 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-93414716-d0fb-45cc-880c-371924a23141 tempest-VolumesActionsTest-1665182479 tempest-VolumesActionsTest-1665182479-project] 10.222.0.20 "GET /compute/v2.1/servers/bdb608d6-12ec-4b1e-9dfb-71c341ec749e" status: 200 len: 1504 microversion: 2.1 time: 0.220456 Jul 05 20:56:56.077948 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 173/357] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:56:55 2022] GET /compute/v2.1/servers/bdb608d6-12ec-4b1e-9dfb-71c341ec749e => generated 1504 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 20:56:56.175546 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-95e39486-7203-471f-b0b0-17c044a8bcb3 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:56:56.185500 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-95e39486-7203-471f-b0b0-17c044a8bcb3 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:56:56.187312 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-95e39486-7203-471f-b0b0-17c044a8bcb3 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:56:56.188654 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-95e39486-7203-471f-b0b0-17c044a8bcb3 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] 10.222.0.20 "GET /compute/v2.1/servers/52848078-62a1-484f-813c-7b3352cb3851" status: 200 len: 1735 microversion: 2.20 time: 0.270032 Jul 05 20:56:56.199617 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 185/358] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 5 20:56:55 2022] GET /compute/v2.1/servers/52848078-62a1-484f-813c-7b3352cb3851 => generated 1735 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 05 20:56:56.582186 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-92896aa3-d176-4170-b814-d901452ce9e2 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:56:56.582787 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-92896aa3-d176-4170-b814-d901452ce9e2 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] [instance: f236112c-4649-478b-a626-b84f8ff1bfe9] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:56:56.589047 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-92896aa3-d176-4170-b814-d901452ce9e2 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:56:56.589472 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-92896aa3-d176-4170-b814-d901452ce9e2 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:56:56.590214 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-92896aa3-d176-4170-b814-d901452ce9e2 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:56:56.590645 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-92896aa3-d176-4170-b814-d901452ce9e2 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:56:56.851176 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-92896aa3-d176-4170-b814-d901452ce9e2 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eac41ce3f04450b840cff305ec1a5ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47e1ad014d542f98f6b24c8a504d166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:56:56.865122 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-92896aa3-d176-4170-b814-d901452ce9e2 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] 10.222.0.20 "GET /compute/v2.1/servers/f236112c-4649-478b-a626-b84f8ff1bfe9" status: 200 len: 1722 microversion: 2.1 time: 0.286683 Jul 05 20:56:56.866809 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 174/359] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:56:56 2022] GET /compute/v2.1/servers/f236112c-4649-478b-a626-b84f8ff1bfe9 => generated 1722 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 20:56:57.094418 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-bab0d6e8-aec2-4078-b1dc-d3f0ee9a71f4 tempest-VolumesActionsTest-1665182479 tempest-VolumesActionsTest-1665182479-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:56:57.095691 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-bab0d6e8-aec2-4078-b1dc-d3f0ee9a71f4 tempest-VolumesActionsTest-1665182479 tempest-VolumesActionsTest-1665182479-project] [instance: bdb608d6-12ec-4b1e-9dfb-71c341ec749e] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:56:57.102942 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-bab0d6e8-aec2-4078-b1dc-d3f0ee9a71f4 tempest-VolumesActionsTest-1665182479 tempest-VolumesActionsTest-1665182479-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:56:57.103991 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-bab0d6e8-aec2-4078-b1dc-d3f0ee9a71f4 tempest-VolumesActionsTest-1665182479 tempest-VolumesActionsTest-1665182479-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:56:57.105011 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-bab0d6e8-aec2-4078-b1dc-d3f0ee9a71f4 tempest-VolumesActionsTest-1665182479 tempest-VolumesActionsTest-1665182479-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:56:57.105616 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-bab0d6e8-aec2-4078-b1dc-d3f0ee9a71f4 tempest-VolumesActionsTest-1665182479 tempest-VolumesActionsTest-1665182479-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:56:57.208726 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-bdc52ee6-2beb-4f47-a464-368fd784a580 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:56:57.209399 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-bdc52ee6-2beb-4f47-a464-368fd784a580 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] [instance: 52848078-62a1-484f-813c-7b3352cb3851] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:56:57.219131 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-bdc52ee6-2beb-4f47-a464-368fd784a580 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:56:57.219931 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-bdc52ee6-2beb-4f47-a464-368fd784a580 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:56:57.220865 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-bdc52ee6-2beb-4f47-a464-368fd784a580 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:56:57.221545 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-bdc52ee6-2beb-4f47-a464-368fd784a580 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:56:57.285230 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-bab0d6e8-aec2-4078-b1dc-d3f0ee9a71f4 tempest-VolumesActionsTest-1665182479 tempest-VolumesActionsTest-1665182479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd273630a84d41f49dcf8208c618f256', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a407f0bf436c4987b9eb2e59c46d82a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:56:57.297505 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-bab0d6e8-aec2-4078-b1dc-d3f0ee9a71f4 tempest-VolumesActionsTest-1665182479 tempest-VolumesActionsTest-1665182479-project] 10.222.0.20 "GET /compute/v2.1/servers/bdb608d6-12ec-4b1e-9dfb-71c341ec749e" status: 200 len: 1462 microversion: 2.1 time: 0.207260 Jul 05 20:56:57.298873 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 186/360] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:56:57 2022] GET /compute/v2.1/servers/bdb608d6-12ec-4b1e-9dfb-71c341ec749e => generated 1462 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 20:56:57.304770 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [req-bb4f98f3-a623-42b2-9b27-85fd44a01299 req-d430b62e-a453-4b93-9a87-9805de0aeb4e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bdb608d6-12ec-4b1e-9dfb-71c341ec749e", "name": "network-vif-deleted", "tag": "0b46cd99-b04f-4b5c-8249-0fb811d094e0"}]} {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 20:56:57.316990 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [req-bb4f98f3-a623-42b2-9b27-85fd44a01299 req-d430b62e-a453-4b93-9a87-9805de0aeb4e service nova] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:56:57.317760 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [req-bb4f98f3-a623-42b2-9b27-85fd44a01299 req-d430b62e-a453-4b93-9a87-9805de0aeb4e service nova] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:56:57.331258 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.compute.server_external_events [req-bb4f98f3-a623-42b2-9b27-85fd44a01299 req-d430b62e-a453-4b93-9a87-9805de0aeb4e service nova] Creating event network-vif-deleted:0b46cd99-b04f-4b5c-8249-0fb811d094e0 for instance bdb608d6-12ec-4b1e-9dfb-71c341ec749e on hv-cinder-79760 Jul 05 20:56:57.336408 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [req-bb4f98f3-a623-42b2-9b27-85fd44a01299 req-d430b62e-a453-4b93-9a87-9805de0aeb4e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035949 Jul 05 20:56:57.337518 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 187/361] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 5 20:56:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 20:56:57.440441 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-bdc52ee6-2beb-4f47-a464-368fd784a580 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:56:57.449754 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-bdc52ee6-2beb-4f47-a464-368fd784a580 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:56:57.452917 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-bdc52ee6-2beb-4f47-a464-368fd784a580 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:56:57.454301 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-bdc52ee6-2beb-4f47-a464-368fd784a580 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] 10.222.0.20 "GET /compute/v2.1/servers/52848078-62a1-484f-813c-7b3352cb3851" status: 200 len: 1735 microversion: 2.20 time: 0.251196 Jul 05 20:56:57.455140 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 175/362] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 5 20:56:57 2022] GET /compute/v2.1/servers/52848078-62a1-484f-813c-7b3352cb3851 => generated 1735 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 20:56:57.890891 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-37b3555c-f3ab-40d2-ac7a-97d53cfd759b tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:56:57.891653 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-37b3555c-f3ab-40d2-ac7a-97d53cfd759b tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] [instance: f236112c-4649-478b-a626-b84f8ff1bfe9] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:56:57.902020 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-37b3555c-f3ab-40d2-ac7a-97d53cfd759b tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:56:57.903713 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-37b3555c-f3ab-40d2-ac7a-97d53cfd759b tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:56:57.906264 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-37b3555c-f3ab-40d2-ac7a-97d53cfd759b tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:56:57.906798 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-37b3555c-f3ab-40d2-ac7a-97d53cfd759b tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:56:58.069588 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-37b3555c-f3ab-40d2-ac7a-97d53cfd759b tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eac41ce3f04450b840cff305ec1a5ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47e1ad014d542f98f6b24c8a504d166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:56:58.078694 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-37b3555c-f3ab-40d2-ac7a-97d53cfd759b tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] 10.222.0.20 "GET /compute/v2.1/servers/f236112c-4649-478b-a626-b84f8ff1bfe9" status: 200 len: 1699 microversion: 2.1 time: 0.198682 Jul 05 20:56:58.079584 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 188/363] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:56:57 2022] GET /compute/v2.1/servers/f236112c-4649-478b-a626-b84f8ff1bfe9 => generated 1699 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 20:56:58.096699 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-365a6770-13cf-4908-8574-1ff6462499f6 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 20:56:58.105249 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-365a6770-13cf-4908-8574-1ff6462499f6 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:56:58.105977 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-365a6770-13cf-4908-8574-1ff6462499f6 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:56:58.108629 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG dbcounter [-] [117627] Writing DB stats nova_cell1:SELECT=100 {{(pid=117627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:56:58.131293 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-365a6770-13cf-4908-8574-1ff6462499f6 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] [instance: f236112c-4649-478b-a626-b84f8ff1bfe9] Going to try to start instance {{(pid=117627) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 05 20:56:58.179941 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-365a6770-13cf-4908-8574-1ff6462499f6 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] 10.222.0.20 "POST /compute/v2.1/servers/f236112c-4649-478b-a626-b84f8ff1bfe9/action" status: 202 len: 0 microversion: 2.1 time: 0.087657 Jul 05 20:56:58.181043 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 176/364] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Jul 5 20:56:58 2022] POST /compute/v2.1/servers/f236112c-4649-478b-a626-b84f8ff1bfe9/action => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 05 20:56:58.190111 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-14fb1f3c-bb8f-4d8f-b34d-8eb1c3d4bf5c tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:56:58.190741 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-14fb1f3c-bb8f-4d8f-b34d-8eb1c3d4bf5c tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] [instance: f236112c-4649-478b-a626-b84f8ff1bfe9] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:56:58.198640 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-14fb1f3c-bb8f-4d8f-b34d-8eb1c3d4bf5c tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:56:58.209164 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-14fb1f3c-bb8f-4d8f-b34d-8eb1c3d4bf5c tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:56:58.209164 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-14fb1f3c-bb8f-4d8f-b34d-8eb1c3d4bf5c tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:56:58.209164 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-14fb1f3c-bb8f-4d8f-b34d-8eb1c3d4bf5c tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:56:58.317523 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-ec44c0f8-e30e-4370-8b58-fe340b4ee700 tempest-VolumesActionsTest-1665182479 tempest-VolumesActionsTest-1665182479-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:56:58.318196 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-ec44c0f8-e30e-4370-8b58-fe340b4ee700 tempest-VolumesActionsTest-1665182479 tempest-VolumesActionsTest-1665182479-project] [instance: bdb608d6-12ec-4b1e-9dfb-71c341ec749e] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:56:58.335287 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-ec44c0f8-e30e-4370-8b58-fe340b4ee700 tempest-VolumesActionsTest-1665182479 tempest-VolumesActionsTest-1665182479-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:56:58.337928 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-ec44c0f8-e30e-4370-8b58-fe340b4ee700 tempest-VolumesActionsTest-1665182479 tempest-VolumesActionsTest-1665182479-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:56:58.341034 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-ec44c0f8-e30e-4370-8b58-fe340b4ee700 tempest-VolumesActionsTest-1665182479 tempest-VolumesActionsTest-1665182479-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:56:58.341626 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-ec44c0f8-e30e-4370-8b58-fe340b4ee700 tempest-VolumesActionsTest-1665182479 tempest-VolumesActionsTest-1665182479-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:56:58.359096 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.wsgi [None req-ec44c0f8-e30e-4370-8b58-fe340b4ee700 tempest-VolumesActionsTest-1665182479 tempest-VolumesActionsTest-1665182479-project] HTTP exception thrown: Instance bdb608d6-12ec-4b1e-9dfb-71c341ec749e could not be found. Jul 05 20:56:58.360979 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-ec44c0f8-e30e-4370-8b58-fe340b4ee700 tempest-VolumesActionsTest-1665182479 tempest-VolumesActionsTest-1665182479-project] Request method failure captured: Jul 05 20:56:58.360979 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: request: GET /compute/v2.1/servers/bdb608d6-12ec-4b1e-9dfb-71c341ec749e HTTP/1.1 Jul 05 20:56:58.360979 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: Accept: application/json Jul 05 20:56:58.360979 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: Accept-Encoding: identity Jul 05 20:56:58.360979 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: Connection: close Jul 05 20:56:58.360979 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: Content-Length: 0 Jul 05 20:56:58.360979 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: Content-Type: application/json Jul 05 20:56:58.360979 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: Host: 10.222.0.20 Jul 05 20:56:58.360979 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: Openstack-System-Scope: None Jul 05 20:56:58.360979 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: User-Agent: python-urllib3/1.26.9 Jul 05 20:56:58.360979 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Auth-Token: gAAAAABixKVtRDF5eIqaOGyYH9szJ7KylNJKpucEkzUHEXp3nLPmbhdCsO78AB8MKE8XGaRtgIfA68hULwS46lM9erEJqTeswfq6XF451cPAZIKjXbxO1admaTpuaMjdSCse8E0AzKvgLty-1JdLMvI2FUoQDkfYdnC7DfxBtwZiqS8Z0y1Aa_0 Jul 05 20:56:58.360979 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Domain-Id: None Jul 05 20:56:58.360979 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Domain-Name: None Jul 05 20:56:58.360979 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Identity-Status: Confirmed Jul 05 20:56:58.360979 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Is-Admin-Project: True Jul 05 20:56:58.360979 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Project-Domain-Id: default Jul 05 20:56:58.360979 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Project-Domain-Name: Default Jul 05 20:56:58.360979 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Project-Id: a407f0bf436c4987b9eb2e59c46d82a9 Jul 05 20:56:58.360979 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Project-Name: tempest-VolumesActionsTest-1665182479 Jul 05 20:56:58.360979 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Role: member,reader Jul 05 20:56:58.360979 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Roles: member,reader Jul 05 20:56:58.362633 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a407f0bf436c4987b9eb2e59c46d82a9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/a407f0bf436c4987b9eb2e59c46d82a9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_a407f0bf436c4987b9eb2e59c46d82a9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a407f0bf436c4987b9eb2e59c46d82a9"}]}] Jul 05 20:56:58.362633 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Tenant: tempest-VolumesActionsTest-1665182479 Jul 05 20:56:58.362633 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Tenant-Id: a407f0bf436c4987b9eb2e59c46d82a9 Jul 05 20:56:58.362633 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Tenant-Name: tempest-VolumesActionsTest-1665182479 Jul 05 20:56:58.362633 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-User: tempest-VolumesActionsTest-1665182479-project Jul 05 20:56:58.362633 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-User-Domain-Id: default Jul 05 20:56:58.362633 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-User-Domain-Name: Default Jul 05 20:56:58.362633 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-User-Id: fd273630a84d41f49dcf8208c618f256 Jul 05 20:56:58.362633 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-User-Name: tempest-VolumesActionsTest-1665182479-project Jul 05 20:56:58.362633 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: method: > Jul 05 20:56:58.362633 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: exception: Instance bdb608d6-12ec-4b1e-9dfb-71c341ec749e could not be found. Jul 05 20:56:58.362633 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: action_args: {'id': 'bdb608d6-12ec-4b1e-9dfb-71c341ec749e'} Jul 05 20:56:58.363539 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 05 20:56:58.363539 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 20:56:58.363539 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 05 20:56:58.363539 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 05 20:56:58.363539 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 05 20:56:58.363539 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 05 20:56:58.363539 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 05 20:56:58.363539 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 05 20:56:58.363539 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 05 20:56:58.363539 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 05 20:56:58.363539 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bdb608d6-12ec-4b1e-9dfb-71c341ec749e could not be found. Jul 05 20:56:58.363539 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi Jul 05 20:56:58.363539 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 20:56:58.363539 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi Jul 05 20:56:58.363539 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 20:56:58.363539 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 20:56:58.363539 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 20:56:58.363539 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 05 20:56:58.363539 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 05 20:56:58.363539 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 05 20:56:58.365082 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 05 20:56:58.365082 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 05 20:56:58.365082 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 05 20:56:58.365082 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 05 20:56:58.365082 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 05 20:56:58.365082 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 05 20:56:58.365082 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 05 20:56:58.365082 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bdb608d6-12ec-4b1e-9dfb-71c341ec749e could not be found. Jul 05 20:56:58.365082 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi Jul 05 20:56:58.365082 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 20:56:58.365082 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi Jul 05 20:56:58.365082 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 20:56:58.365082 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 20:56:58.365082 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 20:56:58.365082 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 05 20:56:58.365082 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 05 20:56:58.365082 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bdb608d6-12ec-4b1e-9dfb-71c341ec749e could not be found. Jul 05 20:56:58.365082 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi Jul 05 20:56:58.366456 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-ec44c0f8-e30e-4370-8b58-fe340b4ee700 tempest-VolumesActionsTest-1665182479 tempest-VolumesActionsTest-1665182479-project] Returning 404 to user: Instance bdb608d6-12ec-4b1e-9dfb-71c341ec749e could not be found. {{(pid=117627) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 05 20:56:58.367049 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-ec44c0f8-e30e-4370-8b58-fe340b4ee700 tempest-VolumesActionsTest-1665182479 tempest-VolumesActionsTest-1665182479-project] 10.222.0.20 "GET /compute/v2.1/servers/bdb608d6-12ec-4b1e-9dfb-71c341ec749e" status: 404 len: 111 microversion: 2.1 time: 0.054130 Jul 05 20:56:58.375091 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 177/365] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:56:58 2022] GET /compute/v2.1/servers/bdb608d6-12ec-4b1e-9dfb-71c341ec749e => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 05 20:56:58.399870 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-14fb1f3c-bb8f-4d8f-b34d-8eb1c3d4bf5c tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eac41ce3f04450b840cff305ec1a5ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47e1ad014d542f98f6b24c8a504d166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:56:58.412798 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-14fb1f3c-bb8f-4d8f-b34d-8eb1c3d4bf5c tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] 10.222.0.20 "GET /compute/v2.1/servers/f236112c-4649-478b-a626-b84f8ff1bfe9" status: 200 len: 1708 microversion: 2.1 time: 0.227057 Jul 05 20:56:58.413429 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 189/366] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:56:58 2022] GET /compute/v2.1/servers/f236112c-4649-478b-a626-b84f8ff1bfe9 => generated 1708 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 20:56:58.474719 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-3d0b1c32-c1e9-4256-a9c6-1d38405c7801 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:56:58.475055 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-3d0b1c32-c1e9-4256-a9c6-1d38405c7801 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] [instance: 52848078-62a1-484f-813c-7b3352cb3851] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:56:58.486112 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-3d0b1c32-c1e9-4256-a9c6-1d38405c7801 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:56:58.489401 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-3d0b1c32-c1e9-4256-a9c6-1d38405c7801 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:56:58.490383 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-3d0b1c32-c1e9-4256-a9c6-1d38405c7801 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:56:58.490935 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-3d0b1c32-c1e9-4256-a9c6-1d38405c7801 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:56:58.793332 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-3d0b1c32-c1e9-4256-a9c6-1d38405c7801 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:56:58.802069 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-3d0b1c32-c1e9-4256-a9c6-1d38405c7801 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:56:58.803588 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-3d0b1c32-c1e9-4256-a9c6-1d38405c7801 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:56:58.806992 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-3d0b1c32-c1e9-4256-a9c6-1d38405c7801 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] 10.222.0.20 "GET /compute/v2.1/servers/52848078-62a1-484f-813c-7b3352cb3851" status: 200 len: 1735 microversion: 2.20 time: 0.335221 Jul 05 20:56:58.808242 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 178/367] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 5 20:56:58 2022] GET /compute/v2.1/servers/52848078-62a1-484f-813c-7b3352cb3851 => generated 1735 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 20:56:59.128102 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-1641c39b-3aee-4c52-80ec-25d2f0e1609b tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1384530414", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-858447728", "security_groups": [{"name": "tempest-secgroup-smoke-1135024658"}], "block_device_mapping_v2": [{"uuid": "a82ed427-9c2e-4767-887b-5206dbadd708", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "cd331159-a19a-44ee-94a4-edd89916e91b"}]}} {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 20:56:59.314566 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.network.neutron [None req-1641c39b-3aee-4c52-80ec-25d2f0e1609b tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] validate_networks() for [('cd331159-a19a-44ee-94a4-edd89916e91b', None, None, None, None, None)] {{(pid=117628) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 05 20:56:59.430459 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-7d8ddf40-99fc-496a-b85f-aa2396a42594 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:56:59.431908 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-7d8ddf40-99fc-496a-b85f-aa2396a42594 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] [instance: f236112c-4649-478b-a626-b84f8ff1bfe9] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:56:59.439830 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-7d8ddf40-99fc-496a-b85f-aa2396a42594 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:56:59.440570 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-7d8ddf40-99fc-496a-b85f-aa2396a42594 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:56:59.449116 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-7d8ddf40-99fc-496a-b85f-aa2396a42594 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:56:59.449857 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-7d8ddf40-99fc-496a-b85f-aa2396a42594 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:57:00.015252 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-7d8ddf40-99fc-496a-b85f-aa2396a42594 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eac41ce3f04450b840cff305ec1a5ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47e1ad014d542f98f6b24c8a504d166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:57:00.023515 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-7d8ddf40-99fc-496a-b85f-aa2396a42594 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] 10.222.0.20 "GET /compute/v2.1/servers/f236112c-4649-478b-a626-b84f8ff1bfe9" status: 200 len: 1708 microversion: 2.1 time: 0.596973 Jul 05 20:57:00.033329 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 179/368] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:56:59 2022] GET /compute/v2.1/servers/f236112c-4649-478b-a626-b84f8ff1bfe9 => generated 1708 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 20:57:00.033329 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-b743b1a0-c8cc-4baf-a71a-6292d48a68e2 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:57:00.033329 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-b743b1a0-c8cc-4baf-a71a-6292d48a68e2 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] [instance: 52848078-62a1-484f-813c-7b3352cb3851] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:57:00.042882 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-b743b1a0-c8cc-4baf-a71a-6292d48a68e2 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:57:00.043390 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-b743b1a0-c8cc-4baf-a71a-6292d48a68e2 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:57:00.044170 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-b743b1a0-c8cc-4baf-a71a-6292d48a68e2 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:57:00.044602 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-b743b1a0-c8cc-4baf-a71a-6292d48a68e2 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:57:00.192922 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.virt.hardware [None req-1641c39b-3aee-4c52-80ec-25d2f0e1609b tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Flavor limits 0:0:0 {{(pid=117628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 05 20:57:00.193382 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.virt.hardware [None req-1641c39b-3aee-4c52-80ec-25d2f0e1609b tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Image limits 0:0:0 {{(pid=117628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 05 20:57:00.193848 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.virt.hardware [None req-1641c39b-3aee-4c52-80ec-25d2f0e1609b tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Flavor pref 0:0:0 {{(pid=117628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 05 20:57:00.194300 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.virt.hardware [None req-1641c39b-3aee-4c52-80ec-25d2f0e1609b tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Image pref 0:0:0 {{(pid=117628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 05 20:57:00.194900 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.virt.hardware [None req-1641c39b-3aee-4c52-80ec-25d2f0e1609b tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 05 20:57:00.211247 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-1641c39b-3aee-4c52-80ec-25d2f0e1609b tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:57:00.211988 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-1641c39b-3aee-4c52-80ec-25d2f0e1609b tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:57:00.212966 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-1641c39b-3aee-4c52-80ec-25d2f0e1609b tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:57:00.213578 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-1641c39b-3aee-4c52-80ec-25d2f0e1609b tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:57:00.237602 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.quota [None req-1641c39b-3aee-4c52-80ec-25d2f0e1609b tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Getting quotas for project 6c9a3d56f8b84eb2a057425afbf79079. Resources: {'cores', 'ram', 'instances'} {{(pid=117628) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 05 20:57:00.238958 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-b743b1a0-c8cc-4baf-a71a-6292d48a68e2 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:57:00.241987 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.quota [None req-1641c39b-3aee-4c52-80ec-25d2f0e1609b tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Getting quotas for user 261feb03a8ff459b8874232bec05034f and project 6c9a3d56f8b84eb2a057425afbf79079. Resources: {'cores', 'ram', 'instances'} {{(pid=117628) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 05 20:57:00.247238 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-b743b1a0-c8cc-4baf-a71a-6292d48a68e2 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:57:00.249464 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-b743b1a0-c8cc-4baf-a71a-6292d48a68e2 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:57:00.250709 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-b743b1a0-c8cc-4baf-a71a-6292d48a68e2 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] 10.222.0.20 "GET /compute/v2.1/servers/52848078-62a1-484f-813c-7b3352cb3851" status: 200 len: 1735 microversion: 2.20 time: 0.225034 Jul 05 20:57:00.259691 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 180/369] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 5 20:57:00 2022] GET /compute/v2.1/servers/52848078-62a1-484f-813c-7b3352cb3851 => generated 1735 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 20:57:00.308671 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-1641c39b-3aee-4c52-80ec-25d2f0e1609b tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Going to run 1 instances... {{(pid=117628) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 05 20:57:00.310936 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-1641c39b-3aee-4c52-80ec-25d2f0e1609b tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] [instance: 843b93d3-5217-4c0f-b8a9-a335f24c615a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='a82ed427-9c2e-4767-887b-5206dbadd708',volume_size=None,volume_type=None)] {{(pid=117628) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 05 20:57:00.479373 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-1641c39b-3aee-4c52-80ec-25d2f0e1609b tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.356058 Jul 05 20:57:00.481129 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 190/370] 10.222.0.20 () {60 vars in 1146 bytes} [Tue Jul 5 20:56:59 2022] POST /compute/v2.1/servers => generated 406 bytes in 1358 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 05 20:57:00.491858 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-a95de707-2258-4b56-aa8a-f66c7ae55e00 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:57:00.492701 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-a95de707-2258-4b56-aa8a-f66c7ae55e00 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] [instance: 843b93d3-5217-4c0f-b8a9-a335f24c615a] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:57:00.563534 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-a95de707-2258-4b56-aa8a-f66c7ae55e00 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '261feb03a8ff459b8874232bec05034f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9a3d56f8b84eb2a057425afbf79079', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:57:00.575242 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-a95de707-2258-4b56-aa8a-f66c7ae55e00 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] 10.222.0.20 "GET /compute/v2.1/servers/843b93d3-5217-4c0f-b8a9-a335f24c615a" status: 200 len: 1094 microversion: 2.1 time: 0.087174 Jul 05 20:57:00.581100 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 181/371] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:57:00 2022] GET /compute/v2.1/servers/843b93d3-5217-4c0f-b8a9-a335f24c615a => generated 1094 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 20:57:01.042347 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-362cf0df-d91a-4fb6-aa6a-3f7a94fc33ec tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:57:01.042966 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-362cf0df-d91a-4fb6-aa6a-3f7a94fc33ec tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] [instance: f236112c-4649-478b-a626-b84f8ff1bfe9] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:57:01.052287 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-362cf0df-d91a-4fb6-aa6a-3f7a94fc33ec tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:57:01.052746 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-362cf0df-d91a-4fb6-aa6a-3f7a94fc33ec tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:57:01.053545 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-362cf0df-d91a-4fb6-aa6a-3f7a94fc33ec tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:57:01.054167 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-362cf0df-d91a-4fb6-aa6a-3f7a94fc33ec tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:57:01.213691 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-362cf0df-d91a-4fb6-aa6a-3f7a94fc33ec tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eac41ce3f04450b840cff305ec1a5ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47e1ad014d542f98f6b24c8a504d166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:57:01.232413 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-362cf0df-d91a-4fb6-aa6a-3f7a94fc33ec tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] 10.222.0.20 "GET /compute/v2.1/servers/f236112c-4649-478b-a626-b84f8ff1bfe9" status: 200 len: 1708 microversion: 2.1 time: 0.194566 Jul 05 20:57:01.233226 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 191/372] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:57:01 2022] GET /compute/v2.1/servers/f236112c-4649-478b-a626-b84f8ff1bfe9 => generated 1708 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 20:57:01.278370 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-d8a26013-ea13-4d42-9f3e-9c9e2fc63ecb tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:57:01.278984 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-d8a26013-ea13-4d42-9f3e-9c9e2fc63ecb tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] [instance: 52848078-62a1-484f-813c-7b3352cb3851] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:57:01.285408 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-d8a26013-ea13-4d42-9f3e-9c9e2fc63ecb tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:57:01.285856 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-d8a26013-ea13-4d42-9f3e-9c9e2fc63ecb tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:57:01.286667 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-d8a26013-ea13-4d42-9f3e-9c9e2fc63ecb tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:57:01.287155 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-d8a26013-ea13-4d42-9f3e-9c9e2fc63ecb tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:57:01.433211 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-d8a26013-ea13-4d42-9f3e-9c9e2fc63ecb tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:57:01.442840 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-d8a26013-ea13-4d42-9f3e-9c9e2fc63ecb tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:57:01.444531 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-d8a26013-ea13-4d42-9f3e-9c9e2fc63ecb tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:57:01.446235 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-d8a26013-ea13-4d42-9f3e-9c9e2fc63ecb tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] 10.222.0.20 "GET /compute/v2.1/servers/52848078-62a1-484f-813c-7b3352cb3851" status: 200 len: 1735 microversion: 2.20 time: 0.172246 Jul 05 20:57:01.457201 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 182/373] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 5 20:57:01 2022] GET /compute/v2.1/servers/52848078-62a1-484f-813c-7b3352cb3851 => generated 1735 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 20:57:01.591629 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-de30755c-27e1-4077-9451-15436a2daf49 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:57:01.593269 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-de30755c-27e1-4077-9451-15436a2daf49 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] [instance: 843b93d3-5217-4c0f-b8a9-a335f24c615a] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:57:01.601678 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-de30755c-27e1-4077-9451-15436a2daf49 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:57:01.602270 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-de30755c-27e1-4077-9451-15436a2daf49 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:57:01.603141 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-de30755c-27e1-4077-9451-15436a2daf49 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:57:01.603660 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-de30755c-27e1-4077-9451-15436a2daf49 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:57:01.672132 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-de30755c-27e1-4077-9451-15436a2daf49 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '261feb03a8ff459b8874232bec05034f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9a3d56f8b84eb2a057425afbf79079', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:57:01.681376 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-de30755c-27e1-4077-9451-15436a2daf49 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] 10.222.0.20 "GET /compute/v2.1/servers/843b93d3-5217-4c0f-b8a9-a335f24c615a" status: 200 len: 1144 microversion: 2.1 time: 0.093239 Jul 05 20:57:01.681978 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 192/374] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:57:01 2022] GET /compute/v2.1/servers/843b93d3-5217-4c0f-b8a9-a335f24c615a => generated 1144 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 20:57:02.251233 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-b615c13e-ab13-42eb-a7ed-2fa28739f7a2 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:57:02.252110 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-b615c13e-ab13-42eb-a7ed-2fa28739f7a2 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] [instance: f236112c-4649-478b-a626-b84f8ff1bfe9] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:57:02.258830 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-b615c13e-ab13-42eb-a7ed-2fa28739f7a2 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:57:02.259280 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-b615c13e-ab13-42eb-a7ed-2fa28739f7a2 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:57:02.260042 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-b615c13e-ab13-42eb-a7ed-2fa28739f7a2 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:57:02.260475 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-b615c13e-ab13-42eb-a7ed-2fa28739f7a2 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:57:02.409148 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-b615c13e-ab13-42eb-a7ed-2fa28739f7a2 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eac41ce3f04450b840cff305ec1a5ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47e1ad014d542f98f6b24c8a504d166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:57:02.429738 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-b615c13e-ab13-42eb-a7ed-2fa28739f7a2 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] 10.222.0.20 "GET /compute/v2.1/servers/f236112c-4649-478b-a626-b84f8ff1bfe9" status: 200 len: 1708 microversion: 2.1 time: 0.182802 Jul 05 20:57:02.431975 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 183/375] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:57:02 2022] GET /compute/v2.1/servers/f236112c-4649-478b-a626-b84f8ff1bfe9 => generated 1708 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 20:57:02.464966 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-2bfdb0f8-c3fb-4bbd-aa10-b4a06631b646 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:57:02.465955 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-2bfdb0f8-c3fb-4bbd-aa10-b4a06631b646 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] [instance: 52848078-62a1-484f-813c-7b3352cb3851] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:57:02.477375 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-2bfdb0f8-c3fb-4bbd-aa10-b4a06631b646 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:57:02.478161 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-2bfdb0f8-c3fb-4bbd-aa10-b4a06631b646 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:57:02.479166 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-2bfdb0f8-c3fb-4bbd-aa10-b4a06631b646 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:57:02.479764 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-2bfdb0f8-c3fb-4bbd-aa10-b4a06631b646 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:57:02.632149 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-2bfdb0f8-c3fb-4bbd-aa10-b4a06631b646 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:57:02.645924 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-2bfdb0f8-c3fb-4bbd-aa10-b4a06631b646 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:57:02.647813 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-2bfdb0f8-c3fb-4bbd-aa10-b4a06631b646 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:57:02.649208 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-2bfdb0f8-c3fb-4bbd-aa10-b4a06631b646 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] 10.222.0.20 "GET /compute/v2.1/servers/52848078-62a1-484f-813c-7b3352cb3851" status: 200 len: 1735 microversion: 2.20 time: 0.188317 Jul 05 20:57:02.650517 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 193/376] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 5 20:57:02 2022] GET /compute/v2.1/servers/52848078-62a1-484f-813c-7b3352cb3851 => generated 1735 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 20:57:02.699649 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-087386ce-db7f-488f-8d4b-4db93b453da0 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:57:02.700477 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-087386ce-db7f-488f-8d4b-4db93b453da0 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] [instance: 843b93d3-5217-4c0f-b8a9-a335f24c615a] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:57:02.707584 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-087386ce-db7f-488f-8d4b-4db93b453da0 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:57:02.708267 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-087386ce-db7f-488f-8d4b-4db93b453da0 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:57:02.709215 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-087386ce-db7f-488f-8d4b-4db93b453da0 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:57:02.709800 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-087386ce-db7f-488f-8d4b-4db93b453da0 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:57:02.789066 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-087386ce-db7f-488f-8d4b-4db93b453da0 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '261feb03a8ff459b8874232bec05034f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9a3d56f8b84eb2a057425afbf79079', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:57:02.799198 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-087386ce-db7f-488f-8d4b-4db93b453da0 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] 10.222.0.20 "GET /compute/v2.1/servers/843b93d3-5217-4c0f-b8a9-a335f24c615a" status: 200 len: 1136 microversion: 2.1 time: 0.103872 Jul 05 20:57:02.800321 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 184/377] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:57:02 2022] GET /compute/v2.1/servers/843b93d3-5217-4c0f-b8a9-a335f24c615a => generated 1136 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 20:57:03.449731 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-eb6e330a-ef70-49ec-ab0b-b9820253dd73 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:57:03.450734 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-eb6e330a-ef70-49ec-ab0b-b9820253dd73 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] [instance: f236112c-4649-478b-a626-b84f8ff1bfe9] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:57:03.464919 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-eb6e330a-ef70-49ec-ab0b-b9820253dd73 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:57:03.465597 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-eb6e330a-ef70-49ec-ab0b-b9820253dd73 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:57:03.466082 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-eb6e330a-ef70-49ec-ab0b-b9820253dd73 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:57:03.467081 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-eb6e330a-ef70-49ec-ab0b-b9820253dd73 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:57:03.639829 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-eb6e330a-ef70-49ec-ab0b-b9820253dd73 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eac41ce3f04450b840cff305ec1a5ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47e1ad014d542f98f6b24c8a504d166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:57:03.648953 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-eb6e330a-ef70-49ec-ab0b-b9820253dd73 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] 10.222.0.20 "GET /compute/v2.1/servers/f236112c-4649-478b-a626-b84f8ff1bfe9" status: 200 len: 1712 microversion: 2.1 time: 0.202891 Jul 05 20:57:03.659844 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 194/378] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:57:03 2022] GET /compute/v2.1/servers/f236112c-4649-478b-a626-b84f8ff1bfe9 => generated 1712 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 20:57:03.670454 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-a38473bc-fde8-49fc-8205-107b4b99c345 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:57:03.671100 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-a38473bc-fde8-49fc-8205-107b4b99c345 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] [instance: 52848078-62a1-484f-813c-7b3352cb3851] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:57:03.683482 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-a38473bc-fde8-49fc-8205-107b4b99c345 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:57:03.683934 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-a38473bc-fde8-49fc-8205-107b4b99c345 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:57:03.684715 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-a38473bc-fde8-49fc-8205-107b4b99c345 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:57:03.685806 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-a38473bc-fde8-49fc-8205-107b4b99c345 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:57:03.818317 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-5ac432fa-3a5e-4c34-82dc-fbffd576b6f1 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:57:03.819285 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-5ac432fa-3a5e-4c34-82dc-fbffd576b6f1 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] [instance: 843b93d3-5217-4c0f-b8a9-a335f24c615a] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:57:03.834711 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-5ac432fa-3a5e-4c34-82dc-fbffd576b6f1 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:57:03.835634 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-5ac432fa-3a5e-4c34-82dc-fbffd576b6f1 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:57:03.836682 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-5ac432fa-3a5e-4c34-82dc-fbffd576b6f1 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:57:03.837389 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-5ac432fa-3a5e-4c34-82dc-fbffd576b6f1 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:57:03.924565 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-a38473bc-fde8-49fc-8205-107b4b99c345 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:57:03.934542 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-a38473bc-fde8-49fc-8205-107b4b99c345 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:57:03.936867 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-a38473bc-fde8-49fc-8205-107b4b99c345 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:57:03.938497 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-a38473bc-fde8-49fc-8205-107b4b99c345 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] 10.222.0.20 "GET /compute/v2.1/servers/52848078-62a1-484f-813c-7b3352cb3851" status: 200 len: 1735 microversion: 2.20 time: 0.272995 Jul 05 20:57:03.939782 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 185/379] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 5 20:57:03 2022] GET /compute/v2.1/servers/52848078-62a1-484f-813c-7b3352cb3851 => generated 1735 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 20:57:03.953912 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-5ac432fa-3a5e-4c34-82dc-fbffd576b6f1 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '261feb03a8ff459b8874232bec05034f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9a3d56f8b84eb2a057425afbf79079', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:57:03.965619 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-5ac432fa-3a5e-4c34-82dc-fbffd576b6f1 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] 10.222.0.20 "GET /compute/v2.1/servers/843b93d3-5217-4c0f-b8a9-a335f24c615a" status: 200 len: 1192 microversion: 2.1 time: 0.153020 Jul 05 20:57:03.978230 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 195/380] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:57:03 2022] GET /compute/v2.1/servers/843b93d3-5217-4c0f-b8a9-a335f24c615a => generated 1192 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 20:57:04.958281 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-fa8e6cbd-c5a3-4755-b2f9-1b6b1a18f341 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:57:04.962754 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-fa8e6cbd-c5a3-4755-b2f9-1b6b1a18f341 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] [instance: 52848078-62a1-484f-813c-7b3352cb3851] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:57:04.986052 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-dd2f7716-62aa-4ad4-a769-5d0e3f53f041 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:57:04.991024 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-dd2f7716-62aa-4ad4-a769-5d0e3f53f041 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] [instance: 843b93d3-5217-4c0f-b8a9-a335f24c615a] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:57:05.000822 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-fa8e6cbd-c5a3-4755-b2f9-1b6b1a18f341 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:57:05.003633 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-fa8e6cbd-c5a3-4755-b2f9-1b6b1a18f341 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:57:05.007749 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-fa8e6cbd-c5a3-4755-b2f9-1b6b1a18f341 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:57:05.011671 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-fa8e6cbd-c5a3-4755-b2f9-1b6b1a18f341 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:57:05.013238 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-dd2f7716-62aa-4ad4-a769-5d0e3f53f041 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:57:05.014037 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-dd2f7716-62aa-4ad4-a769-5d0e3f53f041 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:57:05.021398 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-dd2f7716-62aa-4ad4-a769-5d0e3f53f041 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:57:05.022239 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-dd2f7716-62aa-4ad4-a769-5d0e3f53f041 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:57:05.680595 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-dd2f7716-62aa-4ad4-a769-5d0e3f53f041 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '261feb03a8ff459b8874232bec05034f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9a3d56f8b84eb2a057425afbf79079', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:57:05.690567 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-dd2f7716-62aa-4ad4-a769-5d0e3f53f041 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] 10.222.0.20 "GET /compute/v2.1/servers/843b93d3-5217-4c0f-b8a9-a335f24c615a" status: 200 len: 1278 microversion: 2.1 time: 0.711234 Jul 05 20:57:05.691808 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 196/381] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:57:04 2022] GET /compute/v2.1/servers/843b93d3-5217-4c0f-b8a9-a335f24c615a => generated 1278 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 20:57:05.692283 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-fa8e6cbd-c5a3-4755-b2f9-1b6b1a18f341 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:57:05.709753 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-fa8e6cbd-c5a3-4755-b2f9-1b6b1a18f341 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:57:05.711893 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-fa8e6cbd-c5a3-4755-b2f9-1b6b1a18f341 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:57:05.715071 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-fa8e6cbd-c5a3-4755-b2f9-1b6b1a18f341 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] 10.222.0.20 "GET /compute/v2.1/servers/52848078-62a1-484f-813c-7b3352cb3851" status: 200 len: 1735 microversion: 2.20 time: 0.761168 Jul 05 20:57:05.719147 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 186/382] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 5 20:57:04 2022] GET /compute/v2.1/servers/52848078-62a1-484f-813c-7b3352cb3851 => generated 1735 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 20:57:06.336797 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [req-c435b177-fe07-4ed8-b40e-c6ad1ee2297c req-023caf2a-13cd-46df-b265-ad33bd293b28 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "843b93d3-5217-4c0f-b8a9-a335f24c615a", "tag": "9848df20-e5cf-4e95-93e1-1419520fd1b9"}]} {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 20:57:06.349120 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [req-c435b177-fe07-4ed8-b40e-c6ad1ee2297c req-023caf2a-13cd-46df-b265-ad33bd293b28 service nova] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:57:06.349569 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [req-c435b177-fe07-4ed8-b40e-c6ad1ee2297c req-023caf2a-13cd-46df-b265-ad33bd293b28 service nova] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:57:06.375759 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.compute.server_external_events [req-c435b177-fe07-4ed8-b40e-c6ad1ee2297c req-023caf2a-13cd-46df-b265-ad33bd293b28 service nova] Creating event network-changed:9848df20-e5cf-4e95-93e1-1419520fd1b9 for instance 843b93d3-5217-4c0f-b8a9-a335f24c615a on hv-cinder-79760 Jul 05 20:57:06.388887 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [req-c435b177-fe07-4ed8-b40e-c6ad1ee2297c req-023caf2a-13cd-46df-b265-ad33bd293b28 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055361 Jul 05 20:57:06.389523 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 197/383] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 5 20:57:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 20:57:06.710142 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-b9e70c4e-7700-402f-b52e-a0b3c788fc72 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:57:06.711353 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-b9e70c4e-7700-402f-b52e-a0b3c788fc72 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] [instance: 843b93d3-5217-4c0f-b8a9-a335f24c615a] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:57:06.720779 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-b9e70c4e-7700-402f-b52e-a0b3c788fc72 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:57:06.721610 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-b9e70c4e-7700-402f-b52e-a0b3c788fc72 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:57:06.722569 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-b9e70c4e-7700-402f-b52e-a0b3c788fc72 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:57:06.723160 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-b9e70c4e-7700-402f-b52e-a0b3c788fc72 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:57:06.736129 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-7f877a78-a436-498b-9e0b-7c0b4b46400d tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:57:06.736840 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-7f877a78-a436-498b-9e0b-7c0b4b46400d tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] [instance: 52848078-62a1-484f-813c-7b3352cb3851] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:57:06.747272 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-7f877a78-a436-498b-9e0b-7c0b4b46400d tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:57:06.747805 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-7f877a78-a436-498b-9e0b-7c0b4b46400d tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:57:06.748657 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-7f877a78-a436-498b-9e0b-7c0b4b46400d tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:57:06.755668 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-7f877a78-a436-498b-9e0b-7c0b4b46400d tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:57:07.106763 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-b9e70c4e-7700-402f-b52e-a0b3c788fc72 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '261feb03a8ff459b8874232bec05034f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9a3d56f8b84eb2a057425afbf79079', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:57:07.129069 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-b9e70c4e-7700-402f-b52e-a0b3c788fc72 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] 10.222.0.20 "GET /compute/v2.1/servers/843b93d3-5217-4c0f-b8a9-a335f24c615a" status: 200 len: 1266 microversion: 2.1 time: 0.422580 Jul 05 20:57:07.150769 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 187/384] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:57:06 2022] GET /compute/v2.1/servers/843b93d3-5217-4c0f-b8a9-a335f24c615a => generated 1266 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 20:57:07.214463 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-7f877a78-a436-498b-9e0b-7c0b4b46400d tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:57:07.225145 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-7f877a78-a436-498b-9e0b-7c0b4b46400d tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:57:07.227206 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-7f877a78-a436-498b-9e0b-7c0b4b46400d tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:57:07.231114 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-7f877a78-a436-498b-9e0b-7c0b4b46400d tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] 10.222.0.20 "GET /compute/v2.1/servers/52848078-62a1-484f-813c-7b3352cb3851" status: 200 len: 1717 microversion: 2.20 time: 0.499869 Jul 05 20:57:07.238605 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 198/385] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 5 20:57:06 2022] GET /compute/v2.1/servers/52848078-62a1-484f-813c-7b3352cb3851 => generated 1717 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 20:57:08.159100 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-902c3263-f95a-4761-8a27-783b9c0ac333 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:57:08.160490 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-902c3263-f95a-4761-8a27-783b9c0ac333 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] [instance: 843b93d3-5217-4c0f-b8a9-a335f24c615a] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:57:08.167517 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-902c3263-f95a-4761-8a27-783b9c0ac333 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:57:08.168046 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-902c3263-f95a-4761-8a27-783b9c0ac333 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:57:08.168881 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-902c3263-f95a-4761-8a27-783b9c0ac333 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:57:08.170080 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-902c3263-f95a-4761-8a27-783b9c0ac333 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:57:08.264091 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-93cd76cb-9f52-43eb-ba0f-5897a5f7471e tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:57:08.265356 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-93cd76cb-9f52-43eb-ba0f-5897a5f7471e tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] [instance: 52848078-62a1-484f-813c-7b3352cb3851] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:57:08.276598 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-93cd76cb-9f52-43eb-ba0f-5897a5f7471e tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:57:08.277395 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-93cd76cb-9f52-43eb-ba0f-5897a5f7471e tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:57:08.278446 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-93cd76cb-9f52-43eb-ba0f-5897a5f7471e tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:57:08.279142 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-93cd76cb-9f52-43eb-ba0f-5897a5f7471e tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:57:08.337377 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-902c3263-f95a-4761-8a27-783b9c0ac333 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '261feb03a8ff459b8874232bec05034f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9a3d56f8b84eb2a057425afbf79079', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:57:08.353613 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-902c3263-f95a-4761-8a27-783b9c0ac333 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] 10.222.0.20 "GET /compute/v2.1/servers/843b93d3-5217-4c0f-b8a9-a335f24c615a" status: 200 len: 1266 microversion: 2.1 time: 0.198178 Jul 05 20:57:08.355590 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 188/386] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:57:08 2022] GET /compute/v2.1/servers/843b93d3-5217-4c0f-b8a9-a335f24c615a => generated 1266 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 20:57:08.448152 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-93cd76cb-9f52-43eb-ba0f-5897a5f7471e tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:57:08.460387 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-93cd76cb-9f52-43eb-ba0f-5897a5f7471e tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:57:08.461925 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-93cd76cb-9f52-43eb-ba0f-5897a5f7471e tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:57:08.463090 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-93cd76cb-9f52-43eb-ba0f-5897a5f7471e tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] 10.222.0.20 "GET /compute/v2.1/servers/52848078-62a1-484f-813c-7b3352cb3851" status: 200 len: 1717 microversion: 2.20 time: 0.203602 Jul 05 20:57:08.463646 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 199/387] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 5 20:57:08 2022] GET /compute/v2.1/servers/52848078-62a1-484f-813c-7b3352cb3851 => generated 1717 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 05 20:57:09.371997 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-d176caca-c4b5-4f87-9a63-ef38bfc84a76 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:57:09.373652 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-d176caca-c4b5-4f87-9a63-ef38bfc84a76 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] [instance: 843b93d3-5217-4c0f-b8a9-a335f24c615a] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:57:09.381977 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-d176caca-c4b5-4f87-9a63-ef38bfc84a76 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:57:09.382425 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-d176caca-c4b5-4f87-9a63-ef38bfc84a76 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:57:09.383189 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-d176caca-c4b5-4f87-9a63-ef38bfc84a76 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:57:09.383620 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-d176caca-c4b5-4f87-9a63-ef38bfc84a76 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:57:09.484113 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-63c210e4-574b-47a2-91d3-46c6d933a708 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:57:09.485161 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-63c210e4-574b-47a2-91d3-46c6d933a708 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] [instance: 52848078-62a1-484f-813c-7b3352cb3851] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:57:09.495646 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-63c210e4-574b-47a2-91d3-46c6d933a708 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:57:09.496129 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-63c210e4-574b-47a2-91d3-46c6d933a708 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:57:09.497133 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-63c210e4-574b-47a2-91d3-46c6d933a708 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:57:09.498553 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-63c210e4-574b-47a2-91d3-46c6d933a708 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:57:09.537632 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-d176caca-c4b5-4f87-9a63-ef38bfc84a76 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '261feb03a8ff459b8874232bec05034f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9a3d56f8b84eb2a057425afbf79079', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:57:09.548324 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-d176caca-c4b5-4f87-9a63-ef38bfc84a76 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] 10.222.0.20 "GET /compute/v2.1/servers/843b93d3-5217-4c0f-b8a9-a335f24c615a" status: 200 len: 1266 microversion: 2.1 time: 0.180583 Jul 05 20:57:09.558110 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 189/388] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:57:09 2022] GET /compute/v2.1/servers/843b93d3-5217-4c0f-b8a9-a335f24c615a => generated 1266 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 20:57:09.640394 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-63c210e4-574b-47a2-91d3-46c6d933a708 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:57:09.649543 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-63c210e4-574b-47a2-91d3-46c6d933a708 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:57:09.651393 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-63c210e4-574b-47a2-91d3-46c6d933a708 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:57:09.652661 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-63c210e4-574b-47a2-91d3-46c6d933a708 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] 10.222.0.20 "GET /compute/v2.1/servers/52848078-62a1-484f-813c-7b3352cb3851" status: 200 len: 1717 microversion: 2.20 time: 0.172789 Jul 05 20:57:09.653910 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 200/389] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 5 20:57:09 2022] GET /compute/v2.1/servers/52848078-62a1-484f-813c-7b3352cb3851 => generated 1717 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 20:57:10.572572 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-a8f70da6-0fb9-4bb9-8c6a-a416d21f5fd3 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:57:10.574545 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-a8f70da6-0fb9-4bb9-8c6a-a416d21f5fd3 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] [instance: 843b93d3-5217-4c0f-b8a9-a335f24c615a] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:57:10.587904 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG dbcounter [-] [117627] Writing DB stats nova_cell0:SELECT=2 {{(pid=117627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:57:10.591309 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-a8f70da6-0fb9-4bb9-8c6a-a416d21f5fd3 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:57:10.592493 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-a8f70da6-0fb9-4bb9-8c6a-a416d21f5fd3 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:57:10.593580 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-a8f70da6-0fb9-4bb9-8c6a-a416d21f5fd3 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:57:10.594348 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-a8f70da6-0fb9-4bb9-8c6a-a416d21f5fd3 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:57:10.673918 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-40b1b3d0-f94f-434a-86ee-7b8b70ce5a45 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:57:10.674710 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-40b1b3d0-f94f-434a-86ee-7b8b70ce5a45 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] [instance: 52848078-62a1-484f-813c-7b3352cb3851] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:57:10.683084 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG dbcounter [-] [117628] Writing DB stats nova_cell0:SELECT=2 {{(pid=117628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:57:10.684493 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG dbcounter [-] [117628] Writing DB stats nova_cell0:SELECT=6 {{(pid=117628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:57:10.687210 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-40b1b3d0-f94f-434a-86ee-7b8b70ce5a45 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:57:10.692730 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-40b1b3d0-f94f-434a-86ee-7b8b70ce5a45 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:57:10.693724 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-40b1b3d0-f94f-434a-86ee-7b8b70ce5a45 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:57:10.694413 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-40b1b3d0-f94f-434a-86ee-7b8b70ce5a45 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:57:10.806560 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-a8f70da6-0fb9-4bb9-8c6a-a416d21f5fd3 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '261feb03a8ff459b8874232bec05034f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9a3d56f8b84eb2a057425afbf79079', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:57:10.821940 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-a8f70da6-0fb9-4bb9-8c6a-a416d21f5fd3 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] 10.222.0.20 "GET /compute/v2.1/servers/843b93d3-5217-4c0f-b8a9-a335f24c615a" status: 200 len: 1266 microversion: 2.1 time: 0.256796 Jul 05 20:57:10.830046 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 190/390] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:57:10 2022] GET /compute/v2.1/servers/843b93d3-5217-4c0f-b8a9-a335f24c615a => generated 1266 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 20:57:10.847790 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [req-6a2555e1-48c2-4ce3-b89a-763051e5842c req-3e5c377c-660c-4f3c-b8a1-3ae4f0994f0a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "52848078-62a1-484f-813c-7b3352cb3851", "name": "network-vif-unplugged", "status": "completed", "tag": "1f543410-d13c-44b8-9d38-5417d712191c"}]} {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 20:57:10.862113 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [req-6a2555e1-48c2-4ce3-b89a-763051e5842c req-3e5c377c-660c-4f3c-b8a1-3ae4f0994f0a service nova] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:57:10.867384 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [req-6a2555e1-48c2-4ce3-b89a-763051e5842c req-3e5c377c-660c-4f3c-b8a1-3ae4f0994f0a service nova] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:57:10.890237 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.compute.server_external_events [req-6a2555e1-48c2-4ce3-b89a-763051e5842c req-3e5c377c-660c-4f3c-b8a1-3ae4f0994f0a service nova] Unable to find a host for instance 52848078-62a1-484f-813c-7b3352cb3851. Dropping event network-vif-unplugged {{(pid=117627) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jul 05 20:57:10.893138 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [req-6a2555e1-48c2-4ce3-b89a-763051e5842c req-3e5c377c-660c-4f3c-b8a1-3ae4f0994f0a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.060981 Jul 05 20:57:10.893837 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 191/391] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 5 20:57:10 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 62 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jul 05 20:57:10.900958 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-40b1b3d0-f94f-434a-86ee-7b8b70ce5a45 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:57:10.911669 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-40b1b3d0-f94f-434a-86ee-7b8b70ce5a45 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:57:10.913349 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-40b1b3d0-f94f-434a-86ee-7b8b70ce5a45 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:57:10.915435 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-40b1b3d0-f94f-434a-86ee-7b8b70ce5a45 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] 10.222.0.20 "GET /compute/v2.1/servers/52848078-62a1-484f-813c-7b3352cb3851" status: 200 len: 1660 microversion: 2.20 time: 0.247915 Jul 05 20:57:10.927179 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 201/392] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 5 20:57:10 2022] GET /compute/v2.1/servers/52848078-62a1-484f-813c-7b3352cb3851 => generated 1660 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 20:57:10.936670 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-8b70fc45-f14e-4a26-8951-bfa1c18eed8e tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7716675e-43c6-42ab-8302-7157246311a4"}} {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 20:57:10.937971 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-8b70fc45-f14e-4a26-8951-bfa1c18eed8e tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] [instance: 52848078-62a1-484f-813c-7b3352cb3851] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:57:10.947445 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-8b70fc45-f14e-4a26-8951-bfa1c18eed8e tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:57:10.949549 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-8b70fc45-f14e-4a26-8951-bfa1c18eed8e tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:57:10.951366 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-8b70fc45-f14e-4a26-8951-bfa1c18eed8e tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:57:10.951791 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-8b70fc45-f14e-4a26-8951-bfa1c18eed8e tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:57:11.198368 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG dbcounter [-] [117627] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=117627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:57:11.335060 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-8b70fc45-f14e-4a26-8951-bfa1c18eed8e tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] 10.222.0.20 "POST /compute/v2.1/servers/52848078-62a1-484f-813c-7b3352cb3851/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.404608 Jul 05 20:57:11.335738 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 192/393] 10.222.0.20 () {62 vars in 1363 bytes} [Tue Jul 5 20:57:10 2022] POST /compute/v2.1/servers/52848078-62a1-484f-813c-7b3352cb3851/os-volume_attachments => generated 188 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 05 20:57:11.459715 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-b477ee57-09e3-4c9b-9a2a-951e85e0ee82 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 20:57:11.460195 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-b477ee57-09e3-4c9b-9a2a-951e85e0ee82 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] [instance: 52848078-62a1-484f-813c-7b3352cb3851] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:57:11.466997 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-b477ee57-09e3-4c9b-9a2a-951e85e0ee82 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:57:11.467451 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-b477ee57-09e3-4c9b-9a2a-951e85e0ee82 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:57:11.468218 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-b477ee57-09e3-4c9b-9a2a-951e85e0ee82 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:57:11.468647 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-b477ee57-09e3-4c9b-9a2a-951e85e0ee82 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:57:11.522336 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG dbcounter [-] [117628] Writing DB stats nova_cell1:SELECT=100 {{(pid=117628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:57:11.570113 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-b477ee57-09e3-4c9b-9a2a-951e85e0ee82 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] 10.222.0.20 "POST /compute/v2.1/servers/52848078-62a1-484f-813c-7b3352cb3851/action" status: 202 len: 0 microversion: 2.20 time: 0.113442 Jul 05 20:57:11.573954 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 202/394] 10.222.0.20 () {62 vars in 1318 bytes} [Tue Jul 5 20:57:11 2022] POST /compute/v2.1/servers/52848078-62a1-484f-813c-7b3352cb3851/action => generated 0 bytes in 119 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 05 20:57:11.582432 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-8ec0e6b5-215b-493e-bfcd-27e34124e056 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:57:11.583127 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-8ec0e6b5-215b-493e-bfcd-27e34124e056 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] [instance: 52848078-62a1-484f-813c-7b3352cb3851] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:57:11.598829 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-8ec0e6b5-215b-493e-bfcd-27e34124e056 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:57:11.600622 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-8ec0e6b5-215b-493e-bfcd-27e34124e056 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:57:11.602793 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-8ec0e6b5-215b-493e-bfcd-27e34124e056 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:57:11.603313 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-8ec0e6b5-215b-493e-bfcd-27e34124e056 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:57:11.773857 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-8ec0e6b5-215b-493e-bfcd-27e34124e056 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:57:11.786384 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-8ec0e6b5-215b-493e-bfcd-27e34124e056 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:57:11.787938 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-8ec0e6b5-215b-493e-bfcd-27e34124e056 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:57:11.789423 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-8ec0e6b5-215b-493e-bfcd-27e34124e056 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] 10.222.0.20 "GET /compute/v2.1/servers/52848078-62a1-484f-813c-7b3352cb3851" status: 200 len: 1746 microversion: 2.20 time: 0.214180 Jul 05 20:57:11.789938 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 193/395] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 5 20:57:11 2022] GET /compute/v2.1/servers/52848078-62a1-484f-813c-7b3352cb3851 => generated 1746 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 05 20:57:11.848044 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-4289c507-07ca-476a-b2f3-969cada70e93 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:57:11.849412 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-4289c507-07ca-476a-b2f3-969cada70e93 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] [instance: 843b93d3-5217-4c0f-b8a9-a335f24c615a] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:57:11.859133 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-4289c507-07ca-476a-b2f3-969cada70e93 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:57:11.859656 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-4289c507-07ca-476a-b2f3-969cada70e93 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:57:11.860735 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-4289c507-07ca-476a-b2f3-969cada70e93 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:57:11.861424 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-4289c507-07ca-476a-b2f3-969cada70e93 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:57:12.056049 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-4289c507-07ca-476a-b2f3-969cada70e93 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '261feb03a8ff459b8874232bec05034f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9a3d56f8b84eb2a057425afbf79079', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:57:12.069122 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-4289c507-07ca-476a-b2f3-969cada70e93 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] 10.222.0.20 "GET /compute/v2.1/servers/843b93d3-5217-4c0f-b8a9-a335f24c615a" status: 200 len: 1266 microversion: 2.1 time: 0.226260 Jul 05 20:57:12.069849 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 203/396] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:57:11 2022] GET /compute/v2.1/servers/843b93d3-5217-4c0f-b8a9-a335f24c615a => generated 1266 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 20:57:12.808548 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-44c7cdc4-1d58-419b-885b-cac13af9ac40 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:57:12.809223 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-44c7cdc4-1d58-419b-885b-cac13af9ac40 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] [instance: 52848078-62a1-484f-813c-7b3352cb3851] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:57:12.817162 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-44c7cdc4-1d58-419b-885b-cac13af9ac40 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:57:12.817883 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-44c7cdc4-1d58-419b-885b-cac13af9ac40 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:57:12.818661 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-44c7cdc4-1d58-419b-885b-cac13af9ac40 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:57:12.819276 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-44c7cdc4-1d58-419b-885b-cac13af9ac40 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:57:12.968845 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-44c7cdc4-1d58-419b-885b-cac13af9ac40 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:57:12.980096 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-44c7cdc4-1d58-419b-885b-cac13af9ac40 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:57:12.983074 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-44c7cdc4-1d58-419b-885b-cac13af9ac40 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:57:12.985405 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-44c7cdc4-1d58-419b-885b-cac13af9ac40 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] 10.222.0.20 "GET /compute/v2.1/servers/52848078-62a1-484f-813c-7b3352cb3851" status: 200 len: 1746 microversion: 2.20 time: 0.181165 Jul 05 20:57:12.987250 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 194/397] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 5 20:57:12 2022] GET /compute/v2.1/servers/52848078-62a1-484f-813c-7b3352cb3851 => generated 1746 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 20:57:13.086646 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-413cc5e6-1eff-430c-bd57-b1d333a63a30 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:57:13.087258 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-413cc5e6-1eff-430c-bd57-b1d333a63a30 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] [instance: 843b93d3-5217-4c0f-b8a9-a335f24c615a] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:57:13.094872 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-413cc5e6-1eff-430c-bd57-b1d333a63a30 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:57:13.095302 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-413cc5e6-1eff-430c-bd57-b1d333a63a30 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:57:13.096075 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-413cc5e6-1eff-430c-bd57-b1d333a63a30 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:57:13.096504 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-413cc5e6-1eff-430c-bd57-b1d333a63a30 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:57:13.275544 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-413cc5e6-1eff-430c-bd57-b1d333a63a30 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '261feb03a8ff459b8874232bec05034f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9a3d56f8b84eb2a057425afbf79079', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:57:13.284240 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-413cc5e6-1eff-430c-bd57-b1d333a63a30 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] 10.222.0.20 "GET /compute/v2.1/servers/843b93d3-5217-4c0f-b8a9-a335f24c615a" status: 200 len: 1266 microversion: 2.1 time: 0.201379 Jul 05 20:57:13.285017 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 204/398] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:57:13 2022] GET /compute/v2.1/servers/843b93d3-5217-4c0f-b8a9-a335f24c615a => generated 1266 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 20:57:14.006193 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-dd91db00-31da-44c1-a404-c18871a0b49b tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:57:14.007953 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-dd91db00-31da-44c1-a404-c18871a0b49b tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] [instance: 52848078-62a1-484f-813c-7b3352cb3851] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:57:14.019188 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-dd91db00-31da-44c1-a404-c18871a0b49b tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:57:14.022044 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-dd91db00-31da-44c1-a404-c18871a0b49b tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:57:14.023582 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-dd91db00-31da-44c1-a404-c18871a0b49b tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:57:14.024042 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-dd91db00-31da-44c1-a404-c18871a0b49b tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:57:14.247018 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-dd91db00-31da-44c1-a404-c18871a0b49b tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:57:14.261183 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-dd91db00-31da-44c1-a404-c18871a0b49b tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:57:14.263030 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-dd91db00-31da-44c1-a404-c18871a0b49b tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:57:14.264879 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-dd91db00-31da-44c1-a404-c18871a0b49b tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] 10.222.0.20 "GET /compute/v2.1/servers/52848078-62a1-484f-813c-7b3352cb3851" status: 200 len: 1748 microversion: 2.20 time: 0.263582 Jul 05 20:57:14.266227 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 195/399] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 5 20:57:13 2022] GET /compute/v2.1/servers/52848078-62a1-484f-813c-7b3352cb3851 => generated 1748 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 20:57:14.301697 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-b14b8aab-1e4c-443b-9359-08c315f2a758 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:57:14.302400 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-b14b8aab-1e4c-443b-9359-08c315f2a758 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] [instance: 843b93d3-5217-4c0f-b8a9-a335f24c615a] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:57:14.309227 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-b14b8aab-1e4c-443b-9359-08c315f2a758 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:57:14.310499 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-b14b8aab-1e4c-443b-9359-08c315f2a758 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:57:14.311461 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-b14b8aab-1e4c-443b-9359-08c315f2a758 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:57:14.312061 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-b14b8aab-1e4c-443b-9359-08c315f2a758 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:57:14.476309 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-b14b8aab-1e4c-443b-9359-08c315f2a758 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '261feb03a8ff459b8874232bec05034f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9a3d56f8b84eb2a057425afbf79079', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:57:14.488128 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-b14b8aab-1e4c-443b-9359-08c315f2a758 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] 10.222.0.20 "GET /compute/v2.1/servers/843b93d3-5217-4c0f-b8a9-a335f24c615a" status: 200 len: 1266 microversion: 2.1 time: 0.190368 Jul 05 20:57:14.489011 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 205/400] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:57:14 2022] GET /compute/v2.1/servers/843b93d3-5217-4c0f-b8a9-a335f24c615a => generated 1266 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 20:57:15.284817 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-3e45970e-cb7a-4271-8a8f-8bcb3a77f2c9 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:57:15.285517 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-3e45970e-cb7a-4271-8a8f-8bcb3a77f2c9 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] [instance: 52848078-62a1-484f-813c-7b3352cb3851] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:57:15.292441 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-3e45970e-cb7a-4271-8a8f-8bcb3a77f2c9 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:57:15.292889 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-3e45970e-cb7a-4271-8a8f-8bcb3a77f2c9 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:57:15.293681 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-3e45970e-cb7a-4271-8a8f-8bcb3a77f2c9 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:57:15.294690 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-3e45970e-cb7a-4271-8a8f-8bcb3a77f2c9 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:57:15.439056 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-3e45970e-cb7a-4271-8a8f-8bcb3a77f2c9 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:57:15.448487 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-3e45970e-cb7a-4271-8a8f-8bcb3a77f2c9 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:57:15.450047 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-3e45970e-cb7a-4271-8a8f-8bcb3a77f2c9 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:57:15.451425 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-3e45970e-cb7a-4271-8a8f-8bcb3a77f2c9 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] 10.222.0.20 "GET /compute/v2.1/servers/52848078-62a1-484f-813c-7b3352cb3851" status: 200 len: 1804 microversion: 2.20 time: 0.170376 Jul 05 20:57:15.457283 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 196/401] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 5 20:57:15 2022] GET /compute/v2.1/servers/52848078-62a1-484f-813c-7b3352cb3851 => generated 1804 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 20:57:15.505860 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-7fb7ed80-b652-4f17-b5a3-9c450620ba12 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:57:15.507207 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-7fb7ed80-b652-4f17-b5a3-9c450620ba12 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] [instance: 843b93d3-5217-4c0f-b8a9-a335f24c615a] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:57:15.514381 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-7fb7ed80-b652-4f17-b5a3-9c450620ba12 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:57:15.514835 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-7fb7ed80-b652-4f17-b5a3-9c450620ba12 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:57:15.515615 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-7fb7ed80-b652-4f17-b5a3-9c450620ba12 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:57:15.516053 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-7fb7ed80-b652-4f17-b5a3-9c450620ba12 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:57:15.654261 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-7fb7ed80-b652-4f17-b5a3-9c450620ba12 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '261feb03a8ff459b8874232bec05034f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9a3d56f8b84eb2a057425afbf79079', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:57:15.662586 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-7fb7ed80-b652-4f17-b5a3-9c450620ba12 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] 10.222.0.20 "GET /compute/v2.1/servers/843b93d3-5217-4c0f-b8a9-a335f24c615a" status: 200 len: 1266 microversion: 2.1 time: 0.160578 Jul 05 20:57:15.663155 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 206/402] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:57:15 2022] GET /compute/v2.1/servers/843b93d3-5217-4c0f-b8a9-a335f24c615a => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 20:57:16.471057 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-95235e98-1d2d-4fa7-ae16-b6d965425bd3 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:57:16.471644 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-95235e98-1d2d-4fa7-ae16-b6d965425bd3 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] [instance: 52848078-62a1-484f-813c-7b3352cb3851] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:57:16.479341 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-95235e98-1d2d-4fa7-ae16-b6d965425bd3 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:57:16.480107 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-95235e98-1d2d-4fa7-ae16-b6d965425bd3 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:57:16.481489 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-95235e98-1d2d-4fa7-ae16-b6d965425bd3 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:57:16.482257 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-95235e98-1d2d-4fa7-ae16-b6d965425bd3 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:57:16.661504 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-95235e98-1d2d-4fa7-ae16-b6d965425bd3 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:57:16.671429 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-95235e98-1d2d-4fa7-ae16-b6d965425bd3 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:57:16.673694 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-95235e98-1d2d-4fa7-ae16-b6d965425bd3 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:57:16.681169 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-9977d0de-4039-4fee-a672-43bb0dcf53d6 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:57:16.682413 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-9977d0de-4039-4fee-a672-43bb0dcf53d6 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] [instance: 843b93d3-5217-4c0f-b8a9-a335f24c615a] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:57:16.689290 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-9977d0de-4039-4fee-a672-43bb0dcf53d6 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:57:16.689742 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-9977d0de-4039-4fee-a672-43bb0dcf53d6 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:57:16.690509 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-9977d0de-4039-4fee-a672-43bb0dcf53d6 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:57:16.691409 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-95235e98-1d2d-4fa7-ae16-b6d965425bd3 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] 10.222.0.20 "GET /compute/v2.1/servers/52848078-62a1-484f-813c-7b3352cb3851" status: 200 len: 1804 microversion: 2.20 time: 0.225503 Jul 05 20:57:16.692603 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 197/403] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 5 20:57:16 2022] GET /compute/v2.1/servers/52848078-62a1-484f-813c-7b3352cb3851 => generated 1804 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 20:57:16.693327 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-9977d0de-4039-4fee-a672-43bb0dcf53d6 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:57:16.897002 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-9977d0de-4039-4fee-a672-43bb0dcf53d6 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '261feb03a8ff459b8874232bec05034f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9a3d56f8b84eb2a057425afbf79079', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:57:16.906710 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-9977d0de-4039-4fee-a672-43bb0dcf53d6 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] 10.222.0.20 "GET /compute/v2.1/servers/843b93d3-5217-4c0f-b8a9-a335f24c615a" status: 200 len: 1266 microversion: 2.1 time: 0.230639 Jul 05 20:57:16.907973 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 207/404] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:57:16 2022] GET /compute/v2.1/servers/843b93d3-5217-4c0f-b8a9-a335f24c615a => generated 1266 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 20:57:17.711905 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-e4ba81eb-9d38-41fc-9a85-a0815f2577ed tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:57:17.713500 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-e4ba81eb-9d38-41fc-9a85-a0815f2577ed tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] [instance: 52848078-62a1-484f-813c-7b3352cb3851] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:57:17.725914 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-e4ba81eb-9d38-41fc-9a85-a0815f2577ed tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:57:17.726623 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-e4ba81eb-9d38-41fc-9a85-a0815f2577ed tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:57:17.733365 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-e4ba81eb-9d38-41fc-9a85-a0815f2577ed tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:57:17.734042 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-e4ba81eb-9d38-41fc-9a85-a0815f2577ed tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:57:17.943216 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-23155890-00de-4597-9208-2e29ec611cc5 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:57:17.946042 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-23155890-00de-4597-9208-2e29ec611cc5 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] [instance: 843b93d3-5217-4c0f-b8a9-a335f24c615a] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:57:17.973741 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-23155890-00de-4597-9208-2e29ec611cc5 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:57:17.974644 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-23155890-00de-4597-9208-2e29ec611cc5 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:57:17.977062 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-23155890-00de-4597-9208-2e29ec611cc5 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:57:17.978702 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-23155890-00de-4597-9208-2e29ec611cc5 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:57:18.012129 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-e4ba81eb-9d38-41fc-9a85-a0815f2577ed tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:57:18.022470 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-e4ba81eb-9d38-41fc-9a85-a0815f2577ed tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:57:18.024026 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-e4ba81eb-9d38-41fc-9a85-a0815f2577ed tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:57:18.025507 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-e4ba81eb-9d38-41fc-9a85-a0815f2577ed tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] 10.222.0.20 "GET /compute/v2.1/servers/52848078-62a1-484f-813c-7b3352cb3851" status: 200 len: 1804 microversion: 2.20 time: 0.317800 Jul 05 20:57:18.039531 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 198/405] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 5 20:57:17 2022] GET /compute/v2.1/servers/52848078-62a1-484f-813c-7b3352cb3851 => generated 1804 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 20:57:18.199094 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-23155890-00de-4597-9208-2e29ec611cc5 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '261feb03a8ff459b8874232bec05034f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9a3d56f8b84eb2a057425afbf79079', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:57:18.210078 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-23155890-00de-4597-9208-2e29ec611cc5 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] 10.222.0.20 "GET /compute/v2.1/servers/843b93d3-5217-4c0f-b8a9-a335f24c615a" status: 200 len: 1266 microversion: 2.1 time: 0.280903 Jul 05 20:57:18.212044 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 208/406] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:57:17 2022] GET /compute/v2.1/servers/843b93d3-5217-4c0f-b8a9-a335f24c615a => generated 1266 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 20:57:19.055839 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-e144c1c7-7a21-4dab-9646-d8a6a1336af7 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:57:19.057239 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-e144c1c7-7a21-4dab-9646-d8a6a1336af7 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] [instance: 52848078-62a1-484f-813c-7b3352cb3851] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:57:19.082613 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-e144c1c7-7a21-4dab-9646-d8a6a1336af7 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:57:19.083995 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-e144c1c7-7a21-4dab-9646-d8a6a1336af7 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:57:19.085053 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-e144c1c7-7a21-4dab-9646-d8a6a1336af7 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:57:19.085655 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-e144c1c7-7a21-4dab-9646-d8a6a1336af7 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:57:19.227674 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-5aafffac-647c-4afb-8dd6-6dc5a889b793 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:57:19.229018 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-5aafffac-647c-4afb-8dd6-6dc5a889b793 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] [instance: 843b93d3-5217-4c0f-b8a9-a335f24c615a] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:57:19.231707 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG dbcounter [-] [117628] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=117628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:57:19.246428 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-5aafffac-647c-4afb-8dd6-6dc5a889b793 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:57:19.249248 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-5aafffac-647c-4afb-8dd6-6dc5a889b793 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:57:19.250294 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-5aafffac-647c-4afb-8dd6-6dc5a889b793 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:57:19.251997 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-5aafffac-647c-4afb-8dd6-6dc5a889b793 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:57:19.407252 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-e144c1c7-7a21-4dab-9646-d8a6a1336af7 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:57:19.427288 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-e144c1c7-7a21-4dab-9646-d8a6a1336af7 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:57:19.430682 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-e144c1c7-7a21-4dab-9646-d8a6a1336af7 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:57:19.435206 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-e144c1c7-7a21-4dab-9646-d8a6a1336af7 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] 10.222.0.20 "GET /compute/v2.1/servers/52848078-62a1-484f-813c-7b3352cb3851" status: 200 len: 1804 microversion: 2.20 time: 0.391480 Jul 05 20:57:19.437529 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 199/407] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 5 20:57:19 2022] GET /compute/v2.1/servers/52848078-62a1-484f-813c-7b3352cb3851 => generated 1804 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 20:57:19.536399 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-5aafffac-647c-4afb-8dd6-6dc5a889b793 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '261feb03a8ff459b8874232bec05034f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9a3d56f8b84eb2a057425afbf79079', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:57:19.547588 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-5aafffac-647c-4afb-8dd6-6dc5a889b793 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] 10.222.0.20 "GET /compute/v2.1/servers/843b93d3-5217-4c0f-b8a9-a335f24c615a" status: 200 len: 1266 microversion: 2.1 time: 0.323462 Jul 05 20:57:19.548514 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 209/408] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:57:19 2022] GET /compute/v2.1/servers/843b93d3-5217-4c0f-b8a9-a335f24c615a => generated 1266 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 20:57:20.454792 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-317f71e5-4d58-41c3-bf6a-b92bf1679c84 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:57:20.455522 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-317f71e5-4d58-41c3-bf6a-b92bf1679c84 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] [instance: 52848078-62a1-484f-813c-7b3352cb3851] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:57:20.462464 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-317f71e5-4d58-41c3-bf6a-b92bf1679c84 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:57:20.462907 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-317f71e5-4d58-41c3-bf6a-b92bf1679c84 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:57:20.463859 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-317f71e5-4d58-41c3-bf6a-b92bf1679c84 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:57:20.464292 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-317f71e5-4d58-41c3-bf6a-b92bf1679c84 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:57:20.570862 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-867bcfd4-0f90-4efe-8276-a7a7b9d5865a tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:57:20.572287 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-867bcfd4-0f90-4efe-8276-a7a7b9d5865a tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] [instance: 843b93d3-5217-4c0f-b8a9-a335f24c615a] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:57:20.581163 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-867bcfd4-0f90-4efe-8276-a7a7b9d5865a tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:57:20.581674 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-867bcfd4-0f90-4efe-8276-a7a7b9d5865a tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:57:20.582699 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-867bcfd4-0f90-4efe-8276-a7a7b9d5865a tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:57:20.583331 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-867bcfd4-0f90-4efe-8276-a7a7b9d5865a tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:57:20.634381 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-317f71e5-4d58-41c3-bf6a-b92bf1679c84 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:57:20.643940 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-317f71e5-4d58-41c3-bf6a-b92bf1679c84 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:57:20.645755 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-317f71e5-4d58-41c3-bf6a-b92bf1679c84 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:57:20.647378 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-317f71e5-4d58-41c3-bf6a-b92bf1679c84 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] 10.222.0.20 "GET /compute/v2.1/servers/52848078-62a1-484f-813c-7b3352cb3851" status: 200 len: 1804 microversion: 2.20 time: 0.197170 Jul 05 20:57:20.652819 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 200/409] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 5 20:57:20 2022] GET /compute/v2.1/servers/52848078-62a1-484f-813c-7b3352cb3851 => generated 1804 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 20:57:20.726210 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-867bcfd4-0f90-4efe-8276-a7a7b9d5865a tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '261feb03a8ff459b8874232bec05034f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9a3d56f8b84eb2a057425afbf79079', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:57:20.733865 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-867bcfd4-0f90-4efe-8276-a7a7b9d5865a tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] 10.222.0.20 "GET /compute/v2.1/servers/843b93d3-5217-4c0f-b8a9-a335f24c615a" status: 200 len: 1266 microversion: 2.1 time: 0.167243 Jul 05 20:57:20.734438 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 210/410] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:57:20 2022] GET /compute/v2.1/servers/843b93d3-5217-4c0f-b8a9-a335f24c615a => generated 1266 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 20:57:21.077345 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [req-3d5162f0-422e-477b-ada2-867e0ceccd5f req-babb64d1-494a-4ac8-a204-f254fae6a3ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "843b93d3-5217-4c0f-b8a9-a335f24c615a", "name": "network-vif-plugged", "status": "completed", "tag": "9848df20-e5cf-4e95-93e1-1419520fd1b9"}]} {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 20:57:21.085640 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [req-3d5162f0-422e-477b-ada2-867e0ceccd5f req-babb64d1-494a-4ac8-a204-f254fae6a3ca service nova] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:57:21.086569 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [req-3d5162f0-422e-477b-ada2-867e0ceccd5f req-babb64d1-494a-4ac8-a204-f254fae6a3ca service nova] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:57:21.101911 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.compute.server_external_events [req-3d5162f0-422e-477b-ada2-867e0ceccd5f req-babb64d1-494a-4ac8-a204-f254fae6a3ca service nova] Creating event network-vif-plugged:9848df20-e5cf-4e95-93e1-1419520fd1b9 for instance 843b93d3-5217-4c0f-b8a9-a335f24c615a on hv-cinder-79760 Jul 05 20:57:21.107966 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [req-3d5162f0-422e-477b-ada2-867e0ceccd5f req-babb64d1-494a-4ac8-a204-f254fae6a3ca service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034609 Jul 05 20:57:21.108577 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 201/411] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 5 20:57:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 20:57:21.667635 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-9cdadb33-cafe-4a7c-a573-ab2751d8ad15 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:57:21.668434 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-9cdadb33-cafe-4a7c-a573-ab2751d8ad15 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] [instance: 52848078-62a1-484f-813c-7b3352cb3851] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:57:21.688483 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-9cdadb33-cafe-4a7c-a573-ab2751d8ad15 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:57:21.689187 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-9cdadb33-cafe-4a7c-a573-ab2751d8ad15 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:57:21.689954 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-9cdadb33-cafe-4a7c-a573-ab2751d8ad15 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:57:21.690385 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-9cdadb33-cafe-4a7c-a573-ab2751d8ad15 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:57:21.751584 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-0d213bcc-6dac-4051-9946-fd04419df619 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:57:21.752877 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-0d213bcc-6dac-4051-9946-fd04419df619 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] [instance: 843b93d3-5217-4c0f-b8a9-a335f24c615a] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:57:21.779462 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-0d213bcc-6dac-4051-9946-fd04419df619 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:57:21.780109 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-0d213bcc-6dac-4051-9946-fd04419df619 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:57:21.781404 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-0d213bcc-6dac-4051-9946-fd04419df619 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:57:21.782736 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-0d213bcc-6dac-4051-9946-fd04419df619 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:57:21.951494 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-9cdadb33-cafe-4a7c-a573-ab2751d8ad15 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:57:21.969815 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-9cdadb33-cafe-4a7c-a573-ab2751d8ad15 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:57:21.971804 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-9cdadb33-cafe-4a7c-a573-ab2751d8ad15 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:57:21.973515 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-9cdadb33-cafe-4a7c-a573-ab2751d8ad15 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] 10.222.0.20 "GET /compute/v2.1/servers/52848078-62a1-484f-813c-7b3352cb3851" status: 200 len: 1804 microversion: 2.20 time: 0.311082 Jul 05 20:57:21.989637 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 211/412] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 5 20:57:21 2022] GET /compute/v2.1/servers/52848078-62a1-484f-813c-7b3352cb3851 => generated 1804 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 20:57:22.018965 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-0d213bcc-6dac-4051-9946-fd04419df619 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '261feb03a8ff459b8874232bec05034f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9a3d56f8b84eb2a057425afbf79079', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:57:22.030042 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-0d213bcc-6dac-4051-9946-fd04419df619 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] 10.222.0.20 "GET /compute/v2.1/servers/843b93d3-5217-4c0f-b8a9-a335f24c615a" status: 200 len: 1266 microversion: 2.1 time: 0.282889 Jul 05 20:57:22.030641 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 202/413] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:57:21 2022] GET /compute/v2.1/servers/843b93d3-5217-4c0f-b8a9-a335f24c615a => generated 1266 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 20:57:22.994370 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-44042f54-db5e-4fd3-90cc-b171d9139d17 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:57:22.994973 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-44042f54-db5e-4fd3-90cc-b171d9139d17 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] [instance: 52848078-62a1-484f-813c-7b3352cb3851] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:57:23.002536 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-44042f54-db5e-4fd3-90cc-b171d9139d17 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:57:23.002994 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-44042f54-db5e-4fd3-90cc-b171d9139d17 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:57:23.003770 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-44042f54-db5e-4fd3-90cc-b171d9139d17 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:57:23.004207 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-44042f54-db5e-4fd3-90cc-b171d9139d17 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:57:23.049114 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-3ce8a739-7613-4317-a9cc-575273efc9da tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:57:23.051285 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-3ce8a739-7613-4317-a9cc-575273efc9da tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] [instance: 843b93d3-5217-4c0f-b8a9-a335f24c615a] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:57:23.058306 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-3ce8a739-7613-4317-a9cc-575273efc9da tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:57:23.059072 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-3ce8a739-7613-4317-a9cc-575273efc9da tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:57:23.060349 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-3ce8a739-7613-4317-a9cc-575273efc9da tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:57:23.060864 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-3ce8a739-7613-4317-a9cc-575273efc9da tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:57:23.204684 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-44042f54-db5e-4fd3-90cc-b171d9139d17 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:57:23.214445 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-44042f54-db5e-4fd3-90cc-b171d9139d17 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:57:23.216558 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-44042f54-db5e-4fd3-90cc-b171d9139d17 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:57:23.217754 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-44042f54-db5e-4fd3-90cc-b171d9139d17 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] 10.222.0.20 "GET /compute/v2.1/servers/52848078-62a1-484f-813c-7b3352cb3851" status: 200 len: 1804 microversion: 2.20 time: 0.227344 Jul 05 20:57:23.218310 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 212/414] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 5 20:57:22 2022] GET /compute/v2.1/servers/52848078-62a1-484f-813c-7b3352cb3851 => generated 1804 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 20:57:23.267759 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-3ce8a739-7613-4317-a9cc-575273efc9da tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '261feb03a8ff459b8874232bec05034f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9a3d56f8b84eb2a057425afbf79079', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:57:23.275781 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-3ce8a739-7613-4317-a9cc-575273efc9da tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] 10.222.0.20 "GET /compute/v2.1/servers/843b93d3-5217-4c0f-b8a9-a335f24c615a" status: 200 len: 1266 microversion: 2.1 time: 0.232622 Jul 05 20:57:23.276364 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 203/415] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:57:23 2022] GET /compute/v2.1/servers/843b93d3-5217-4c0f-b8a9-a335f24c615a => generated 1266 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 20:57:24.236153 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-cb7ba313-38d2-4592-a750-8d6d9bb41a56 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:57:24.236945 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-cb7ba313-38d2-4592-a750-8d6d9bb41a56 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] [instance: 52848078-62a1-484f-813c-7b3352cb3851] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:57:24.243801 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-cb7ba313-38d2-4592-a750-8d6d9bb41a56 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:57:24.244547 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-cb7ba313-38d2-4592-a750-8d6d9bb41a56 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:57:24.245728 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-cb7ba313-38d2-4592-a750-8d6d9bb41a56 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:57:24.246831 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-cb7ba313-38d2-4592-a750-8d6d9bb41a56 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:57:24.293041 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-e5ddef9f-9172-4d5d-84d4-32009aaa4c76 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:57:24.294412 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-e5ddef9f-9172-4d5d-84d4-32009aaa4c76 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] [instance: 843b93d3-5217-4c0f-b8a9-a335f24c615a] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:57:24.301484 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-e5ddef9f-9172-4d5d-84d4-32009aaa4c76 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:57:24.301952 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-e5ddef9f-9172-4d5d-84d4-32009aaa4c76 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:57:24.302714 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-e5ddef9f-9172-4d5d-84d4-32009aaa4c76 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:57:24.303143 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-e5ddef9f-9172-4d5d-84d4-32009aaa4c76 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:57:24.498854 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-cb7ba313-38d2-4592-a750-8d6d9bb41a56 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:57:24.511521 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-cb7ba313-38d2-4592-a750-8d6d9bb41a56 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:57:24.514436 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-cb7ba313-38d2-4592-a750-8d6d9bb41a56 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:57:24.515113 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-e5ddef9f-9172-4d5d-84d4-32009aaa4c76 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '261feb03a8ff459b8874232bec05034f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9a3d56f8b84eb2a057425afbf79079', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:57:24.516209 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-cb7ba313-38d2-4592-a750-8d6d9bb41a56 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] 10.222.0.20 "GET /compute/v2.1/servers/52848078-62a1-484f-813c-7b3352cb3851" status: 200 len: 1804 microversion: 2.20 time: 0.284220 Jul 05 20:57:24.516968 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 213/416] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 5 20:57:24 2022] GET /compute/v2.1/servers/52848078-62a1-484f-813c-7b3352cb3851 => generated 1804 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 20:57:24.523231 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-e5ddef9f-9172-4d5d-84d4-32009aaa4c76 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] 10.222.0.20 "GET /compute/v2.1/servers/843b93d3-5217-4c0f-b8a9-a335f24c615a" status: 200 len: 1266 microversion: 2.1 time: 0.233935 Jul 05 20:57:24.527452 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 204/417] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:57:24 2022] GET /compute/v2.1/servers/843b93d3-5217-4c0f-b8a9-a335f24c615a => generated 1266 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 20:57:25.555886 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-bad5e85d-4d8a-4f8e-99d5-b08d840f9a0b tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:57:25.569209 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-bad5e85d-4d8a-4f8e-99d5-b08d840f9a0b tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] [instance: 52848078-62a1-484f-813c-7b3352cb3851] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:57:25.570161 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-9f8e2020-7e98-4911-88f3-123c94a673fe tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:57:25.571621 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-9f8e2020-7e98-4911-88f3-123c94a673fe tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] [instance: 843b93d3-5217-4c0f-b8a9-a335f24c615a] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:57:25.577435 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-bad5e85d-4d8a-4f8e-99d5-b08d840f9a0b tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:57:25.577878 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-bad5e85d-4d8a-4f8e-99d5-b08d840f9a0b tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:57:25.578877 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-bad5e85d-4d8a-4f8e-99d5-b08d840f9a0b tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:57:25.579517 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-bad5e85d-4d8a-4f8e-99d5-b08d840f9a0b tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:57:25.579643 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-9f8e2020-7e98-4911-88f3-123c94a673fe tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:57:25.586555 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-9f8e2020-7e98-4911-88f3-123c94a673fe tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:57:25.587969 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-9f8e2020-7e98-4911-88f3-123c94a673fe tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:57:25.590177 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-9f8e2020-7e98-4911-88f3-123c94a673fe tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:57:25.817058 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-bad5e85d-4d8a-4f8e-99d5-b08d840f9a0b tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:57:25.829666 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-bad5e85d-4d8a-4f8e-99d5-b08d840f9a0b tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:57:25.831627 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-bad5e85d-4d8a-4f8e-99d5-b08d840f9a0b tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:57:25.834081 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-bad5e85d-4d8a-4f8e-99d5-b08d840f9a0b tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] 10.222.0.20 "GET /compute/v2.1/servers/52848078-62a1-484f-813c-7b3352cb3851" status: 200 len: 1804 microversion: 2.20 time: 0.293577 Jul 05 20:57:25.836005 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 214/418] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 5 20:57:25 2022] GET /compute/v2.1/servers/52848078-62a1-484f-813c-7b3352cb3851 => generated 1804 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 20:57:25.856113 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-9f8e2020-7e98-4911-88f3-123c94a673fe tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '261feb03a8ff459b8874232bec05034f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9a3d56f8b84eb2a057425afbf79079', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:57:25.864844 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-9f8e2020-7e98-4911-88f3-123c94a673fe tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] 10.222.0.20 "GET /compute/v2.1/servers/843b93d3-5217-4c0f-b8a9-a335f24c615a" status: 200 len: 1266 microversion: 2.1 time: 0.323447 Jul 05 20:57:25.865512 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 205/419] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:57:25 2022] GET /compute/v2.1/servers/843b93d3-5217-4c0f-b8a9-a335f24c615a => generated 1266 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 20:57:26.853754 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-d9e05d04-9faa-4a39-bc02-15538705f1b0 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:57:26.854387 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-d9e05d04-9faa-4a39-bc02-15538705f1b0 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] [instance: 52848078-62a1-484f-813c-7b3352cb3851] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:57:26.861308 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-d9e05d04-9faa-4a39-bc02-15538705f1b0 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:57:26.862176 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-d9e05d04-9faa-4a39-bc02-15538705f1b0 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:57:26.863208 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-d9e05d04-9faa-4a39-bc02-15538705f1b0 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:57:26.863712 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-d9e05d04-9faa-4a39-bc02-15538705f1b0 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:57:26.890298 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-9bdd0a25-cbf0-4a31-85bd-059dfa8c6088 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:57:26.890926 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-9bdd0a25-cbf0-4a31-85bd-059dfa8c6088 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] [instance: 843b93d3-5217-4c0f-b8a9-a335f24c615a] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:57:26.897921 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG dbcounter [-] [117627] Writing DB stats nova_api:SELECT=70 {{(pid=117627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:57:26.910041 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-9bdd0a25-cbf0-4a31-85bd-059dfa8c6088 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:57:26.910503 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-9bdd0a25-cbf0-4a31-85bd-059dfa8c6088 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:57:26.911280 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-9bdd0a25-cbf0-4a31-85bd-059dfa8c6088 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:57:26.911737 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-9bdd0a25-cbf0-4a31-85bd-059dfa8c6088 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:57:27.104329 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-d9e05d04-9faa-4a39-bc02-15538705f1b0 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:57:27.114033 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-d9e05d04-9faa-4a39-bc02-15538705f1b0 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:57:27.116059 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-d9e05d04-9faa-4a39-bc02-15538705f1b0 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:57:27.117455 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-d9e05d04-9faa-4a39-bc02-15538705f1b0 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] 10.222.0.20 "GET /compute/v2.1/servers/52848078-62a1-484f-813c-7b3352cb3851" status: 200 len: 1804 microversion: 2.20 time: 0.267567 Jul 05 20:57:27.118011 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 215/420] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 5 20:57:26 2022] GET /compute/v2.1/servers/52848078-62a1-484f-813c-7b3352cb3851 => generated 1804 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 20:57:27.140464 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-9bdd0a25-cbf0-4a31-85bd-059dfa8c6088 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '261feb03a8ff459b8874232bec05034f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9a3d56f8b84eb2a057425afbf79079', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:57:27.150929 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-9bdd0a25-cbf0-4a31-85bd-059dfa8c6088 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] 10.222.0.20 "GET /compute/v2.1/servers/843b93d3-5217-4c0f-b8a9-a335f24c615a" status: 200 len: 1266 microversion: 2.1 time: 0.272503 Jul 05 20:57:27.151894 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 206/421] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:57:26 2022] GET /compute/v2.1/servers/843b93d3-5217-4c0f-b8a9-a335f24c615a => generated 1266 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 20:57:28.136060 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-0cf96683-c83a-4968-a42e-5788c9e615bf tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:57:28.136691 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-0cf96683-c83a-4968-a42e-5788c9e615bf tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] [instance: 52848078-62a1-484f-813c-7b3352cb3851] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:57:28.143868 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-0cf96683-c83a-4968-a42e-5788c9e615bf tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:57:28.144395 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-0cf96683-c83a-4968-a42e-5788c9e615bf tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:57:28.145189 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-0cf96683-c83a-4968-a42e-5788c9e615bf tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:57:28.145628 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-0cf96683-c83a-4968-a42e-5788c9e615bf tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:57:28.173940 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-99fa4319-5e82-42e5-a445-342c06ff54fe tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:57:28.174562 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-99fa4319-5e82-42e5-a445-342c06ff54fe tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] [instance: 843b93d3-5217-4c0f-b8a9-a335f24c615a] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:57:28.180768 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-99fa4319-5e82-42e5-a445-342c06ff54fe tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:57:28.181244 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-99fa4319-5e82-42e5-a445-342c06ff54fe tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:57:28.182013 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-99fa4319-5e82-42e5-a445-342c06ff54fe tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:57:28.182449 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-99fa4319-5e82-42e5-a445-342c06ff54fe tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:57:28.344224 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-0cf96683-c83a-4968-a42e-5788c9e615bf tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:57:28.352952 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-0cf96683-c83a-4968-a42e-5788c9e615bf tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:57:28.354465 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-0cf96683-c83a-4968-a42e-5788c9e615bf tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:57:28.355633 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-0cf96683-c83a-4968-a42e-5788c9e615bf tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] 10.222.0.20 "GET /compute/v2.1/servers/52848078-62a1-484f-813c-7b3352cb3851" status: 200 len: 1804 microversion: 2.20 time: 0.223579 Jul 05 20:57:28.356740 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 216/422] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 5 20:57:28 2022] GET /compute/v2.1/servers/52848078-62a1-484f-813c-7b3352cb3851 => generated 1804 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 20:57:28.368842 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-99fa4319-5e82-42e5-a445-342c06ff54fe tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '261feb03a8ff459b8874232bec05034f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9a3d56f8b84eb2a057425afbf79079', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:57:28.376653 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-99fa4319-5e82-42e5-a445-342c06ff54fe tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] 10.222.0.20 "GET /compute/v2.1/servers/843b93d3-5217-4c0f-b8a9-a335f24c615a" status: 200 len: 1266 microversion: 2.1 time: 0.207119 Jul 05 20:57:28.377255 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 207/423] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:57:28 2022] GET /compute/v2.1/servers/843b93d3-5217-4c0f-b8a9-a335f24c615a => generated 1266 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 20:57:29.373933 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-b84a5672-e979-4245-8c73-48d0bcc0b086 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:57:29.374633 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-b84a5672-e979-4245-8c73-48d0bcc0b086 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] [instance: 52848078-62a1-484f-813c-7b3352cb3851] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:57:29.384062 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-b84a5672-e979-4245-8c73-48d0bcc0b086 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:57:29.384511 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-b84a5672-e979-4245-8c73-48d0bcc0b086 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:57:29.389349 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-b84a5672-e979-4245-8c73-48d0bcc0b086 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:57:29.389817 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-b84a5672-e979-4245-8c73-48d0bcc0b086 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:57:29.394050 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-edff3fe7-6b20-43c1-9fd8-3e554c9d5dbd tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:57:29.395081 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-edff3fe7-6b20-43c1-9fd8-3e554c9d5dbd tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] [instance: 843b93d3-5217-4c0f-b8a9-a335f24c615a] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:57:29.406585 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-edff3fe7-6b20-43c1-9fd8-3e554c9d5dbd tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:57:29.406824 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-edff3fe7-6b20-43c1-9fd8-3e554c9d5dbd tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:57:29.408965 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-edff3fe7-6b20-43c1-9fd8-3e554c9d5dbd tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:57:29.410235 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-edff3fe7-6b20-43c1-9fd8-3e554c9d5dbd tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:57:29.922547 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-b84a5672-e979-4245-8c73-48d0bcc0b086 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:57:29.931024 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-b84a5672-e979-4245-8c73-48d0bcc0b086 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:57:29.931249 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-edff3fe7-6b20-43c1-9fd8-3e554c9d5dbd tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '261feb03a8ff459b8874232bec05034f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9a3d56f8b84eb2a057425afbf79079', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:57:29.932526 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-b84a5672-e979-4245-8c73-48d0bcc0b086 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:57:29.933706 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-b84a5672-e979-4245-8c73-48d0bcc0b086 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] 10.222.0.20 "GET /compute/v2.1/servers/52848078-62a1-484f-813c-7b3352cb3851" status: 200 len: 1804 microversion: 2.20 time: 0.563861 Jul 05 20:57:29.934278 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 217/424] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 5 20:57:29 2022] GET /compute/v2.1/servers/52848078-62a1-484f-813c-7b3352cb3851 => generated 1804 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 20:57:29.934572 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG dbcounter [-] [117627] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=117627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:57:29.941317 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-edff3fe7-6b20-43c1-9fd8-3e554c9d5dbd tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] 10.222.0.20 "GET /compute/v2.1/servers/843b93d3-5217-4c0f-b8a9-a335f24c615a" status: 200 len: 1266 microversion: 2.1 time: 0.551076 Jul 05 20:57:29.941894 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 208/425] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:57:29 2022] GET /compute/v2.1/servers/843b93d3-5217-4c0f-b8a9-a335f24c615a => generated 1266 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 20:57:30.951929 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-678014a8-0edb-4dc7-8154-3d79d372ace0 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:57:30.952534 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-678014a8-0edb-4dc7-8154-3d79d372ace0 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] [instance: 52848078-62a1-484f-813c-7b3352cb3851] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:57:30.958966 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-8e4b8df7-d8cf-40c4-ad58-6f3a4bc67c38 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:57:30.959529 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-678014a8-0edb-4dc7-8154-3d79d372ace0 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:57:30.959870 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-8e4b8df7-d8cf-40c4-ad58-6f3a4bc67c38 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] [instance: 843b93d3-5217-4c0f-b8a9-a335f24c615a] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:57:30.959978 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-678014a8-0edb-4dc7-8154-3d79d372ace0 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:57:30.960731 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-678014a8-0edb-4dc7-8154-3d79d372ace0 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:57:30.961195 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-678014a8-0edb-4dc7-8154-3d79d372ace0 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:57:30.967683 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-8e4b8df7-d8cf-40c4-ad58-6f3a4bc67c38 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:57:30.968123 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-8e4b8df7-d8cf-40c4-ad58-6f3a4bc67c38 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:57:30.968892 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-8e4b8df7-d8cf-40c4-ad58-6f3a4bc67c38 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:57:30.969383 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-8e4b8df7-d8cf-40c4-ad58-6f3a4bc67c38 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:57:30.979135 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG dbcounter [-] [117628] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:57:31.180095 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-8e4b8df7-d8cf-40c4-ad58-6f3a4bc67c38 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '261feb03a8ff459b8874232bec05034f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9a3d56f8b84eb2a057425afbf79079', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:57:31.184609 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-678014a8-0edb-4dc7-8154-3d79d372ace0 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:57:31.188911 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-8e4b8df7-d8cf-40c4-ad58-6f3a4bc67c38 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] 10.222.0.20 "GET /compute/v2.1/servers/843b93d3-5217-4c0f-b8a9-a335f24c615a" status: 200 len: 1452 microversion: 2.1 time: 0.233866 Jul 05 20:57:31.190881 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 209/426] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:57:30 2022] GET /compute/v2.1/servers/843b93d3-5217-4c0f-b8a9-a335f24c615a => generated 1452 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 20:57:31.195565 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-678014a8-0edb-4dc7-8154-3d79d372ace0 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:57:31.197765 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-678014a8-0edb-4dc7-8154-3d79d372ace0 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:57:31.198979 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-678014a8-0edb-4dc7-8154-3d79d372ace0 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] 10.222.0.20 "GET /compute/v2.1/servers/52848078-62a1-484f-813c-7b3352cb3851" status: 200 len: 1804 microversion: 2.20 time: 0.251484 Jul 05 20:57:31.199582 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 218/427] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 5 20:57:30 2022] GET /compute/v2.1/servers/52848078-62a1-484f-813c-7b3352cb3851 => generated 1804 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 20:57:31.208004 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-4ce768d8-a78d-459e-a69f-5be96e1ca458 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:57:31.208682 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-4ce768d8-a78d-459e-a69f-5be96e1ca458 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] [instance: 843b93d3-5217-4c0f-b8a9-a335f24c615a] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:57:31.214860 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-4ce768d8-a78d-459e-a69f-5be96e1ca458 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:57:31.215891 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-4ce768d8-a78d-459e-a69f-5be96e1ca458 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:57:31.217040 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-4ce768d8-a78d-459e-a69f-5be96e1ca458 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:57:31.217478 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-4ce768d8-a78d-459e-a69f-5be96e1ca458 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:57:31.362324 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-4ce768d8-a78d-459e-a69f-5be96e1ca458 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '261feb03a8ff459b8874232bec05034f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9a3d56f8b84eb2a057425afbf79079', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:57:31.370147 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-4ce768d8-a78d-459e-a69f-5be96e1ca458 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] 10.222.0.20 "GET /compute/v2.1/servers/843b93d3-5217-4c0f-b8a9-a335f24c615a" status: 200 len: 1452 microversion: 2.1 time: 0.166086 Jul 05 20:57:31.370678 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 210/428] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:57:31 2022] GET /compute/v2.1/servers/843b93d3-5217-4c0f-b8a9-a335f24c615a => generated 1452 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 20:57:32.218091 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-de33442c-2145-4397-ac67-d4a8d29953b5 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:57:32.218730 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-de33442c-2145-4397-ac67-d4a8d29953b5 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] [instance: 52848078-62a1-484f-813c-7b3352cb3851] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:57:32.225652 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-de33442c-2145-4397-ac67-d4a8d29953b5 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:57:32.226260 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-de33442c-2145-4397-ac67-d4a8d29953b5 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:57:32.227035 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-de33442c-2145-4397-ac67-d4a8d29953b5 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:57:32.227469 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-de33442c-2145-4397-ac67-d4a8d29953b5 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:57:32.479625 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-de33442c-2145-4397-ac67-d4a8d29953b5 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:57:32.495359 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-de33442c-2145-4397-ac67-d4a8d29953b5 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:57:32.496888 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-de33442c-2145-4397-ac67-d4a8d29953b5 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:57:32.498752 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-de33442c-2145-4397-ac67-d4a8d29953b5 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] 10.222.0.20 "GET /compute/v2.1/servers/52848078-62a1-484f-813c-7b3352cb3851" status: 200 len: 1804 microversion: 2.20 time: 0.285333 Jul 05 20:57:32.510062 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 219/429] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 5 20:57:32 2022] GET /compute/v2.1/servers/52848078-62a1-484f-813c-7b3352cb3851 => generated 1804 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 20:57:33.281037 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [req-af0803e1-a81c-4df4-b9dd-1fbf937ac173 req-f367f4e1-6c36-440e-8a44-aa10d48dd831 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "843b93d3-5217-4c0f-b8a9-a335f24c615a", "tag": "9848df20-e5cf-4e95-93e1-1419520fd1b9"}]} {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 20:57:33.289344 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [req-af0803e1-a81c-4df4-b9dd-1fbf937ac173 req-f367f4e1-6c36-440e-8a44-aa10d48dd831 service nova] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:57:33.289787 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [req-af0803e1-a81c-4df4-b9dd-1fbf937ac173 req-f367f4e1-6c36-440e-8a44-aa10d48dd831 service nova] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:57:33.301491 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.compute.server_external_events [req-af0803e1-a81c-4df4-b9dd-1fbf937ac173 req-f367f4e1-6c36-440e-8a44-aa10d48dd831 service nova] Creating event network-changed:9848df20-e5cf-4e95-93e1-1419520fd1b9 for instance 843b93d3-5217-4c0f-b8a9-a335f24c615a on hv-cinder-79760 Jul 05 20:57:33.306441 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [req-af0803e1-a81c-4df4-b9dd-1fbf937ac173 req-f367f4e1-6c36-440e-8a44-aa10d48dd831 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029911 Jul 05 20:57:33.307032 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 211/430] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 5 20:57:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 20:57:33.518886 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-26631751-3d86-472d-a328-5246fb12547b tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:57:33.519501 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-26631751-3d86-472d-a328-5246fb12547b tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] [instance: 52848078-62a1-484f-813c-7b3352cb3851] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:57:33.526771 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-26631751-3d86-472d-a328-5246fb12547b tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:57:33.527316 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-26631751-3d86-472d-a328-5246fb12547b tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:57:33.528488 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-26631751-3d86-472d-a328-5246fb12547b tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:57:33.529261 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-26631751-3d86-472d-a328-5246fb12547b tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:57:33.725732 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-26631751-3d86-472d-a328-5246fb12547b tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:57:33.738962 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-26631751-3d86-472d-a328-5246fb12547b tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:57:33.741901 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-26631751-3d86-472d-a328-5246fb12547b tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:57:33.744190 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-26631751-3d86-472d-a328-5246fb12547b tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] 10.222.0.20 "GET /compute/v2.1/servers/52848078-62a1-484f-813c-7b3352cb3851" status: 200 len: 1804 microversion: 2.20 time: 0.229221 Jul 05 20:57:33.757707 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 220/431] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 5 20:57:33 2022] GET /compute/v2.1/servers/52848078-62a1-484f-813c-7b3352cb3851 => generated 1804 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 20:57:34.765382 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-b087b0ea-9e7b-43fb-9105-5ecd9bbf2f82 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:57:34.765980 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-b087b0ea-9e7b-43fb-9105-5ecd9bbf2f82 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] [instance: 52848078-62a1-484f-813c-7b3352cb3851] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:57:34.772168 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-b087b0ea-9e7b-43fb-9105-5ecd9bbf2f82 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:57:34.772609 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-b087b0ea-9e7b-43fb-9105-5ecd9bbf2f82 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:57:34.773390 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-b087b0ea-9e7b-43fb-9105-5ecd9bbf2f82 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:57:34.774085 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-b087b0ea-9e7b-43fb-9105-5ecd9bbf2f82 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:57:35.149261 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-b087b0ea-9e7b-43fb-9105-5ecd9bbf2f82 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:57:35.158061 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-b087b0ea-9e7b-43fb-9105-5ecd9bbf2f82 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:57:35.159586 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-b087b0ea-9e7b-43fb-9105-5ecd9bbf2f82 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:57:35.160749 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-b087b0ea-9e7b-43fb-9105-5ecd9bbf2f82 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] 10.222.0.20 "GET /compute/v2.1/servers/52848078-62a1-484f-813c-7b3352cb3851" status: 200 len: 1804 microversion: 2.20 time: 0.400877 Jul 05 20:57:35.161322 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 212/432] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 5 20:57:34 2022] GET /compute/v2.1/servers/52848078-62a1-484f-813c-7b3352cb3851 => generated 1804 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 20:57:36.179458 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-f2967afd-6bc1-45d8-b0f4-419e0f5ede60 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:57:36.180088 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-f2967afd-6bc1-45d8-b0f4-419e0f5ede60 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] [instance: 52848078-62a1-484f-813c-7b3352cb3851] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:57:36.186931 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-f2967afd-6bc1-45d8-b0f4-419e0f5ede60 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:57:36.187454 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-f2967afd-6bc1-45d8-b0f4-419e0f5ede60 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:57:36.188312 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-f2967afd-6bc1-45d8-b0f4-419e0f5ede60 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:57:36.188812 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-f2967afd-6bc1-45d8-b0f4-419e0f5ede60 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:57:36.320660 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-f2967afd-6bc1-45d8-b0f4-419e0f5ede60 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:57:36.330201 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-f2967afd-6bc1-45d8-b0f4-419e0f5ede60 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:57:36.331704 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-f2967afd-6bc1-45d8-b0f4-419e0f5ede60 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:57:36.332846 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-f2967afd-6bc1-45d8-b0f4-419e0f5ede60 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] 10.222.0.20 "GET /compute/v2.1/servers/52848078-62a1-484f-813c-7b3352cb3851" status: 200 len: 1804 microversion: 2.20 time: 0.157229 Jul 05 20:57:36.333421 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 221/433] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 5 20:57:36 2022] GET /compute/v2.1/servers/52848078-62a1-484f-813c-7b3352cb3851 => generated 1804 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 05 20:57:37.350687 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-fb1cdab9-af9e-42a4-97cc-6b5e4ff7219b tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:57:37.351218 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-fb1cdab9-af9e-42a4-97cc-6b5e4ff7219b tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] [instance: 52848078-62a1-484f-813c-7b3352cb3851] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:57:37.358891 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-fb1cdab9-af9e-42a4-97cc-6b5e4ff7219b tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:57:37.359335 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-fb1cdab9-af9e-42a4-97cc-6b5e4ff7219b tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:57:37.360086 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-fb1cdab9-af9e-42a4-97cc-6b5e4ff7219b tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:57:37.360518 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-fb1cdab9-af9e-42a4-97cc-6b5e4ff7219b tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:57:37.493075 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-fb1cdab9-af9e-42a4-97cc-6b5e4ff7219b tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:57:37.501718 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-fb1cdab9-af9e-42a4-97cc-6b5e4ff7219b tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:57:37.503470 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-fb1cdab9-af9e-42a4-97cc-6b5e4ff7219b tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:57:37.504957 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-fb1cdab9-af9e-42a4-97cc-6b5e4ff7219b tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] 10.222.0.20 "GET /compute/v2.1/servers/52848078-62a1-484f-813c-7b3352cb3851" status: 200 len: 1804 microversion: 2.20 time: 0.158119 Jul 05 20:57:37.505661 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 213/434] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 5 20:57:37 2022] GET /compute/v2.1/servers/52848078-62a1-484f-813c-7b3352cb3851 => generated 1804 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 20:57:38.523938 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-185ba441-acf5-4b4e-9b94-788928f41c61 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:57:38.524662 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-185ba441-acf5-4b4e-9b94-788928f41c61 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] [instance: 52848078-62a1-484f-813c-7b3352cb3851] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:57:38.532661 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-185ba441-acf5-4b4e-9b94-788928f41c61 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:57:38.533147 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-185ba441-acf5-4b4e-9b94-788928f41c61 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:57:38.533912 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-185ba441-acf5-4b4e-9b94-788928f41c61 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:57:38.534351 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-185ba441-acf5-4b4e-9b94-788928f41c61 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:57:38.662455 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-185ba441-acf5-4b4e-9b94-788928f41c61 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:57:38.670959 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-185ba441-acf5-4b4e-9b94-788928f41c61 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:57:38.672436 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-185ba441-acf5-4b4e-9b94-788928f41c61 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:57:38.673599 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-185ba441-acf5-4b4e-9b94-788928f41c61 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] 10.222.0.20 "GET /compute/v2.1/servers/52848078-62a1-484f-813c-7b3352cb3851" status: 200 len: 1804 microversion: 2.20 time: 0.153896 Jul 05 20:57:38.674144 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 222/435] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 5 20:57:38 2022] GET /compute/v2.1/servers/52848078-62a1-484f-813c-7b3352cb3851 => generated 1804 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 20:57:39.691648 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-32494b2a-5e04-453a-92b6-e766d81d8c71 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:57:39.692187 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-32494b2a-5e04-453a-92b6-e766d81d8c71 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] [instance: 52848078-62a1-484f-813c-7b3352cb3851] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:57:39.698723 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-32494b2a-5e04-453a-92b6-e766d81d8c71 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:57:39.699709 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-32494b2a-5e04-453a-92b6-e766d81d8c71 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:57:39.700540 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-32494b2a-5e04-453a-92b6-e766d81d8c71 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:57:39.701000 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-32494b2a-5e04-453a-92b6-e766d81d8c71 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:57:39.835235 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-32494b2a-5e04-453a-92b6-e766d81d8c71 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:57:39.844274 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-32494b2a-5e04-453a-92b6-e766d81d8c71 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:57:39.845793 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-32494b2a-5e04-453a-92b6-e766d81d8c71 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:57:39.846959 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-32494b2a-5e04-453a-92b6-e766d81d8c71 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] 10.222.0.20 "GET /compute/v2.1/servers/52848078-62a1-484f-813c-7b3352cb3851" status: 200 len: 1804 microversion: 2.20 time: 0.159355 Jul 05 20:57:39.847508 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 214/436] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 5 20:57:39 2022] GET /compute/v2.1/servers/52848078-62a1-484f-813c-7b3352cb3851 => generated 1804 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 20:57:40.864954 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-5508d411-0547-448e-9a9f-c2e3a54e3bb2 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:57:40.865569 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-5508d411-0547-448e-9a9f-c2e3a54e3bb2 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] [instance: 52848078-62a1-484f-813c-7b3352cb3851] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:57:40.872461 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-5508d411-0547-448e-9a9f-c2e3a54e3bb2 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:57:40.873015 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-5508d411-0547-448e-9a9f-c2e3a54e3bb2 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:57:40.873744 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-5508d411-0547-448e-9a9f-c2e3a54e3bb2 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:57:40.874170 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-5508d411-0547-448e-9a9f-c2e3a54e3bb2 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:57:41.006284 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-5508d411-0547-448e-9a9f-c2e3a54e3bb2 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:57:41.016420 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-5508d411-0547-448e-9a9f-c2e3a54e3bb2 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:57:41.017971 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-5508d411-0547-448e-9a9f-c2e3a54e3bb2 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:57:41.019123 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-5508d411-0547-448e-9a9f-c2e3a54e3bb2 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] 10.222.0.20 "GET /compute/v2.1/servers/52848078-62a1-484f-813c-7b3352cb3851" status: 200 len: 1804 microversion: 2.20 time: 0.158073 Jul 05 20:57:41.020032 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 223/437] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 5 20:57:40 2022] GET /compute/v2.1/servers/52848078-62a1-484f-813c-7b3352cb3851 => generated 1804 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 20:57:42.037812 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-0d4418ae-de08-430c-8b04-35f5e4f3f35b tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:57:42.038413 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-0d4418ae-de08-430c-8b04-35f5e4f3f35b tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] [instance: 52848078-62a1-484f-813c-7b3352cb3851] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:57:42.045100 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-0d4418ae-de08-430c-8b04-35f5e4f3f35b tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:57:42.045542 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-0d4418ae-de08-430c-8b04-35f5e4f3f35b tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:57:42.046295 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-0d4418ae-de08-430c-8b04-35f5e4f3f35b tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:57:42.046727 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-0d4418ae-de08-430c-8b04-35f5e4f3f35b tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:57:42.060178 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [req-0198c682-fd5c-4458-be7e-8e66f826ccba req-f48c47e4-9817-41f8-8909-1c0998cd219f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "52848078-62a1-484f-813c-7b3352cb3851", "name": "network-vif-plugged", "status": "completed", "tag": "1f543410-d13c-44b8-9d38-5417d712191c"}]} {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 20:57:42.070298 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [req-0198c682-fd5c-4458-be7e-8e66f826ccba req-f48c47e4-9817-41f8-8909-1c0998cd219f service nova] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:57:42.070798 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [req-0198c682-fd5c-4458-be7e-8e66f826ccba req-f48c47e4-9817-41f8-8909-1c0998cd219f service nova] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:57:42.086439 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.compute.server_external_events [req-0198c682-fd5c-4458-be7e-8e66f826ccba req-f48c47e4-9817-41f8-8909-1c0998cd219f service nova] Creating event network-vif-plugged:1f543410-d13c-44b8-9d38-5417d712191c for instance 52848078-62a1-484f-813c-7b3352cb3851 on hv-cinder-79760 Jul 05 20:57:42.092793 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [req-0198c682-fd5c-4458-be7e-8e66f826ccba req-f48c47e4-9817-41f8-8909-1c0998cd219f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036213 Jul 05 20:57:42.093429 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 224/438] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 5 20:57:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 05 20:57:42.197882 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-0d4418ae-de08-430c-8b04-35f5e4f3f35b tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:57:42.207611 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-0d4418ae-de08-430c-8b04-35f5e4f3f35b tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:57:42.209147 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-0d4418ae-de08-430c-8b04-35f5e4f3f35b tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:57:42.210289 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-0d4418ae-de08-430c-8b04-35f5e4f3f35b tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] 10.222.0.20 "GET /compute/v2.1/servers/52848078-62a1-484f-813c-7b3352cb3851" status: 200 len: 1804 microversion: 2.20 time: 0.176351 Jul 05 20:57:42.210992 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 215/439] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 5 20:57:42 2022] GET /compute/v2.1/servers/52848078-62a1-484f-813c-7b3352cb3851 => generated 1804 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 20:57:43.230402 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-4dc1a7ed-cb35-4403-915b-8a1ad247ce0e tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:57:43.231086 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-4dc1a7ed-cb35-4403-915b-8a1ad247ce0e tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] [instance: 52848078-62a1-484f-813c-7b3352cb3851] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:57:43.237712 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-4dc1a7ed-cb35-4403-915b-8a1ad247ce0e tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:57:43.238160 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-4dc1a7ed-cb35-4403-915b-8a1ad247ce0e tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:57:43.238905 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-4dc1a7ed-cb35-4403-915b-8a1ad247ce0e tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:57:43.239331 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-4dc1a7ed-cb35-4403-915b-8a1ad247ce0e tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:57:43.376567 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-4dc1a7ed-cb35-4403-915b-8a1ad247ce0e tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:57:43.388521 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-4dc1a7ed-cb35-4403-915b-8a1ad247ce0e tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:57:43.389764 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-4dc1a7ed-cb35-4403-915b-8a1ad247ce0e tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:57:43.390965 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-4dc1a7ed-cb35-4403-915b-8a1ad247ce0e tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] 10.222.0.20 "GET /compute/v2.1/servers/52848078-62a1-484f-813c-7b3352cb3851" status: 200 len: 1804 microversion: 2.20 time: 0.164843 Jul 05 20:57:43.391474 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 225/440] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 5 20:57:43 2022] GET /compute/v2.1/servers/52848078-62a1-484f-813c-7b3352cb3851 => generated 1804 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 20:57:44.410092 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-65e7d934-5151-4cb2-8ba0-836d3e127de7 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:57:44.410694 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-65e7d934-5151-4cb2-8ba0-836d3e127de7 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] [instance: 52848078-62a1-484f-813c-7b3352cb3851] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:57:44.416867 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-65e7d934-5151-4cb2-8ba0-836d3e127de7 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:57:44.417350 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-65e7d934-5151-4cb2-8ba0-836d3e127de7 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:57:44.418115 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-65e7d934-5151-4cb2-8ba0-836d3e127de7 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:57:44.418542 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-65e7d934-5151-4cb2-8ba0-836d3e127de7 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:57:44.559909 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-65e7d934-5151-4cb2-8ba0-836d3e127de7 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:57:44.568457 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-65e7d934-5151-4cb2-8ba0-836d3e127de7 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:57:44.570179 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-65e7d934-5151-4cb2-8ba0-836d3e127de7 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:57:44.571356 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-65e7d934-5151-4cb2-8ba0-836d3e127de7 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] 10.222.0.20 "GET /compute/v2.1/servers/52848078-62a1-484f-813c-7b3352cb3851" status: 200 len: 1804 microversion: 2.20 time: 0.165151 Jul 05 20:57:44.571870 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 216/441] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 5 20:57:44 2022] GET /compute/v2.1/servers/52848078-62a1-484f-813c-7b3352cb3851 => generated 1804 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 20:57:45.590835 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-723981bb-cb03-4d04-b1b9-781e35e1620f tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:57:45.591613 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-723981bb-cb03-4d04-b1b9-781e35e1620f tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] [instance: 52848078-62a1-484f-813c-7b3352cb3851] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:57:45.600747 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-723981bb-cb03-4d04-b1b9-781e35e1620f tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:57:45.601379 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-723981bb-cb03-4d04-b1b9-781e35e1620f tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:57:45.602320 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-723981bb-cb03-4d04-b1b9-781e35e1620f tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:57:45.602763 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-723981bb-cb03-4d04-b1b9-781e35e1620f tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:57:45.748062 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-723981bb-cb03-4d04-b1b9-781e35e1620f tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:57:45.756904 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-723981bb-cb03-4d04-b1b9-781e35e1620f tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:57:45.758427 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-723981bb-cb03-4d04-b1b9-781e35e1620f tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:57:45.759582 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-723981bb-cb03-4d04-b1b9-781e35e1620f tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] 10.222.0.20 "GET /compute/v2.1/servers/52848078-62a1-484f-813c-7b3352cb3851" status: 200 len: 1804 microversion: 2.20 time: 0.173025 Jul 05 20:57:45.760152 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 226/442] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 5 20:57:45 2022] GET /compute/v2.1/servers/52848078-62a1-484f-813c-7b3352cb3851 => generated 1804 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 20:57:46.664234 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-48dd413c-afee-44c2-9a87-6436cb97f278 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f96cb636-9caf-4760-908c-b1b0f1b55a85"}} {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 20:57:46.665466 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-48dd413c-afee-44c2-9a87-6436cb97f278 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] [instance: c6c3c1ea-31e8-4c65-b73d-669f337bee2f] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:57:46.672292 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-48dd413c-afee-44c2-9a87-6436cb97f278 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:57:46.672810 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-48dd413c-afee-44c2-9a87-6436cb97f278 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:57:46.673543 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-48dd413c-afee-44c2-9a87-6436cb97f278 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:57:46.673985 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-48dd413c-afee-44c2-9a87-6436cb97f278 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:57:46.779695 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-934e570b-3ed2-407c-9e32-96ece0015baf tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:57:46.780582 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-934e570b-3ed2-407c-9e32-96ece0015baf tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] [instance: 52848078-62a1-484f-813c-7b3352cb3851] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:57:46.789827 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-934e570b-3ed2-407c-9e32-96ece0015baf tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:57:46.790270 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-934e570b-3ed2-407c-9e32-96ece0015baf tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:57:46.791033 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-934e570b-3ed2-407c-9e32-96ece0015baf tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:57:46.791461 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-934e570b-3ed2-407c-9e32-96ece0015baf tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:57:46.938583 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-934e570b-3ed2-407c-9e32-96ece0015baf tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:57:46.948019 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-934e570b-3ed2-407c-9e32-96ece0015baf tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:57:46.950014 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-934e570b-3ed2-407c-9e32-96ece0015baf tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:57:46.951320 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-934e570b-3ed2-407c-9e32-96ece0015baf tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] 10.222.0.20 "GET /compute/v2.1/servers/52848078-62a1-484f-813c-7b3352cb3851" status: 200 len: 1791 microversion: 2.20 time: 0.177113 Jul 05 20:57:46.951870 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 227/443] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 5 20:57:46 2022] GET /compute/v2.1/servers/52848078-62a1-484f-813c-7b3352cb3851 => generated 1791 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 05 20:57:46.973956 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-48dd413c-afee-44c2-9a87-6436cb97f278 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] 10.222.0.20 "POST /compute/v2.1/servers/c6c3c1ea-31e8-4c65-b73d-669f337bee2f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.313429 Jul 05 20:57:46.975210 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 217/444] 10.222.0.20 () {60 vars in 1322 bytes} [Tue Jul 5 20:57:46 2022] POST /compute/v2.1/servers/c6c3c1ea-31e8-4c65-b73d-669f337bee2f/os-volume_attachments => generated 194 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 20:57:54.495037 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-ec502114-6b40-4f04-8b92-28d8ab498a2f tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 20:57:54.496321 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-ec502114-6b40-4f04-8b92-28d8ab498a2f tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] [instance: c6c3c1ea-31e8-4c65-b73d-669f337bee2f] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:57:54.499059 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG dbcounter [-] [117628] Writing DB stats nova_api:SELECT=38 {{(pid=117628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:57:54.505941 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-ec502114-6b40-4f04-8b92-28d8ab498a2f tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:57:54.506427 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-ec502114-6b40-4f04-8b92-28d8ab498a2f tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:57:54.507200 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-ec502114-6b40-4f04-8b92-28d8ab498a2f tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:57:54.507630 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-ec502114-6b40-4f04-8b92-28d8ab498a2f tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:57:54.531512 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.objects.instance [None req-ec502114-6b40-4f04-8b92-28d8ab498a2f tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lazy-loading 'flavor' on Instance uuid c6c3c1ea-31e8-4c65-b73d-669f337bee2f {{(pid=117628) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 05 20:57:54.657030 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-ec502114-6b40-4f04-8b92-28d8ab498a2f tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] 10.222.0.20 "POST /compute/v2.1/servers/c6c3c1ea-31e8-4c65-b73d-669f337bee2f/action" status: 200 len: 32 microversion: 2.1 time: 0.165931 Jul 05 20:57:54.657636 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 228/445] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Jul 5 20:57:54 2022] POST /compute/v2.1/servers/c6c3c1ea-31e8-4c65-b73d-669f337bee2f/action => generated 32 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 05 20:57:54.669567 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-53e6037e-cf6a-4d42-b411-5e1b1e7c5fb2 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:57:54.670265 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-53e6037e-cf6a-4d42-b411-5e1b1e7c5fb2 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] [instance: c6c3c1ea-31e8-4c65-b73d-669f337bee2f] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:57:54.677735 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-53e6037e-cf6a-4d42-b411-5e1b1e7c5fb2 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:57:54.678322 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-53e6037e-cf6a-4d42-b411-5e1b1e7c5fb2 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:57:54.679467 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-53e6037e-cf6a-4d42-b411-5e1b1e7c5fb2 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:57:54.680065 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-53e6037e-cf6a-4d42-b411-5e1b1e7c5fb2 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:57:54.923809 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-53e6037e-cf6a-4d42-b411-5e1b1e7c5fb2 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd152763a64794301b21587ab2b395bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc6d47f96d17471d94367bc8f8a3e3f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:57:54.931933 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-53e6037e-cf6a-4d42-b411-5e1b1e7c5fb2 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] 10.222.0.20 "GET /compute/v2.1/servers/c6c3c1ea-31e8-4c65-b73d-669f337bee2f" status: 200 len: 1734 microversion: 2.1 time: 0.267508 Jul 05 20:57:54.932503 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 218/446] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:57:54 2022] GET /compute/v2.1/servers/c6c3c1ea-31e8-4c65-b73d-669f337bee2f => generated 1734 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 20:57:55.950252 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-d793076c-09d8-4f4f-bf9f-47979f8840d8 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:57:55.951102 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-d793076c-09d8-4f4f-bf9f-47979f8840d8 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] [instance: c6c3c1ea-31e8-4c65-b73d-669f337bee2f] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:57:55.957842 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-d793076c-09d8-4f4f-bf9f-47979f8840d8 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:57:55.958283 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-d793076c-09d8-4f4f-bf9f-47979f8840d8 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:57:55.959158 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-d793076c-09d8-4f4f-bf9f-47979f8840d8 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:57:55.959585 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-d793076c-09d8-4f4f-bf9f-47979f8840d8 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:57:56.116021 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-d793076c-09d8-4f4f-bf9f-47979f8840d8 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd152763a64794301b21587ab2b395bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc6d47f96d17471d94367bc8f8a3e3f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:57:56.124023 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-d793076c-09d8-4f4f-bf9f-47979f8840d8 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] 10.222.0.20 "GET /compute/v2.1/servers/c6c3c1ea-31e8-4c65-b73d-669f337bee2f" status: 200 len: 1734 microversion: 2.1 time: 0.178541 Jul 05 20:57:56.124581 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 229/447] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:57:55 2022] GET /compute/v2.1/servers/c6c3c1ea-31e8-4c65-b73d-669f337bee2f => generated 1734 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 20:57:57.141597 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-46978b1f-788b-445f-86e2-377c14a45802 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:57:57.142201 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-46978b1f-788b-445f-86e2-377c14a45802 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] [instance: c6c3c1ea-31e8-4c65-b73d-669f337bee2f] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:57:57.144661 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG dbcounter [-] [117627] Writing DB stats nova_api:SELECT=26 {{(pid=117627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:57:57.150392 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-46978b1f-788b-445f-86e2-377c14a45802 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:57:57.150839 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-46978b1f-788b-445f-86e2-377c14a45802 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:57:57.151594 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-46978b1f-788b-445f-86e2-377c14a45802 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:57:57.152028 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-46978b1f-788b-445f-86e2-377c14a45802 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:57:57.287977 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-46978b1f-788b-445f-86e2-377c14a45802 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd152763a64794301b21587ab2b395bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc6d47f96d17471d94367bc8f8a3e3f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:57:57.297521 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-46978b1f-788b-445f-86e2-377c14a45802 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] 10.222.0.20 "GET /compute/v2.1/servers/c6c3c1ea-31e8-4c65-b73d-669f337bee2f" status: 200 len: 1734 microversion: 2.1 time: 0.159585 Jul 05 20:57:57.298176 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 219/448] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:57:57 2022] GET /compute/v2.1/servers/c6c3c1ea-31e8-4c65-b73d-669f337bee2f => generated 1734 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 20:57:58.314427 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-af53a52f-7b76-4f08-9950-67bd8124deda tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:57:58.315075 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-af53a52f-7b76-4f08-9950-67bd8124deda tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] [instance: c6c3c1ea-31e8-4c65-b73d-669f337bee2f] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:57:58.321638 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-af53a52f-7b76-4f08-9950-67bd8124deda tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:57:58.322096 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-af53a52f-7b76-4f08-9950-67bd8124deda tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:57:58.323619 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-af53a52f-7b76-4f08-9950-67bd8124deda tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:57:58.323914 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-af53a52f-7b76-4f08-9950-67bd8124deda tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:57:58.454867 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-af53a52f-7b76-4f08-9950-67bd8124deda tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd152763a64794301b21587ab2b395bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc6d47f96d17471d94367bc8f8a3e3f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:57:58.462876 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-af53a52f-7b76-4f08-9950-67bd8124deda tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] 10.222.0.20 "GET /compute/v2.1/servers/c6c3c1ea-31e8-4c65-b73d-669f337bee2f" status: 200 len: 1734 microversion: 2.1 time: 0.152247 Jul 05 20:57:58.463435 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 230/449] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:57:58 2022] GET /compute/v2.1/servers/c6c3c1ea-31e8-4c65-b73d-669f337bee2f => generated 1734 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 20:57:59.480716 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-b87ae45e-519d-4e3d-90ca-0bb5fb19f7fa tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:57:59.481353 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-b87ae45e-519d-4e3d-90ca-0bb5fb19f7fa tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] [instance: c6c3c1ea-31e8-4c65-b73d-669f337bee2f] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:57:59.488013 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-b87ae45e-519d-4e3d-90ca-0bb5fb19f7fa tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:57:59.488463 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-b87ae45e-519d-4e3d-90ca-0bb5fb19f7fa tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:57:59.489249 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-b87ae45e-519d-4e3d-90ca-0bb5fb19f7fa tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:57:59.489684 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-b87ae45e-519d-4e3d-90ca-0bb5fb19f7fa tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:57:59.621762 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-b87ae45e-519d-4e3d-90ca-0bb5fb19f7fa tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd152763a64794301b21587ab2b395bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc6d47f96d17471d94367bc8f8a3e3f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:57:59.629799 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-b87ae45e-519d-4e3d-90ca-0bb5fb19f7fa tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] 10.222.0.20 "GET /compute/v2.1/servers/c6c3c1ea-31e8-4c65-b73d-669f337bee2f" status: 200 len: 1734 microversion: 2.1 time: 0.152972 Jul 05 20:57:59.630360 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 220/450] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:57:59 2022] GET /compute/v2.1/servers/c6c3c1ea-31e8-4c65-b73d-669f337bee2f => generated 1734 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 20:58:00.649010 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-a90fa9a5-09b5-4f5c-936a-16e98ec8ae4a tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:58:00.649608 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-a90fa9a5-09b5-4f5c-936a-16e98ec8ae4a tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] [instance: c6c3c1ea-31e8-4c65-b73d-669f337bee2f] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:58:00.656793 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-a90fa9a5-09b5-4f5c-936a-16e98ec8ae4a tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:58:00.657269 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-a90fa9a5-09b5-4f5c-936a-16e98ec8ae4a tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:58:00.658016 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-a90fa9a5-09b5-4f5c-936a-16e98ec8ae4a tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:58:00.658443 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-a90fa9a5-09b5-4f5c-936a-16e98ec8ae4a tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:58:00.786391 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-a90fa9a5-09b5-4f5c-936a-16e98ec8ae4a tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd152763a64794301b21587ab2b395bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc6d47f96d17471d94367bc8f8a3e3f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:58:00.794375 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-a90fa9a5-09b5-4f5c-936a-16e98ec8ae4a tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] 10.222.0.20 "GET /compute/v2.1/servers/c6c3c1ea-31e8-4c65-b73d-669f337bee2f" status: 200 len: 1734 microversion: 2.1 time: 0.149512 Jul 05 20:58:00.795012 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 231/451] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:58:00 2022] GET /compute/v2.1/servers/c6c3c1ea-31e8-4c65-b73d-669f337bee2f => generated 1734 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 20:58:01.811503 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-4f46102a-0b37-4705-8df1-ce8ad10a2895 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:58:01.812109 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-4f46102a-0b37-4705-8df1-ce8ad10a2895 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] [instance: c6c3c1ea-31e8-4c65-b73d-669f337bee2f] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:58:01.818660 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-4f46102a-0b37-4705-8df1-ce8ad10a2895 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:58:01.819108 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-4f46102a-0b37-4705-8df1-ce8ad10a2895 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:58:01.819861 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-4f46102a-0b37-4705-8df1-ce8ad10a2895 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:58:01.820296 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-4f46102a-0b37-4705-8df1-ce8ad10a2895 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:58:01.824570 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG dbcounter [-] [117627] Writing DB stats nova_cell1:SELECT=75,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:58:01.950730 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-4f46102a-0b37-4705-8df1-ce8ad10a2895 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd152763a64794301b21587ab2b395bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc6d47f96d17471d94367bc8f8a3e3f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:58:01.959129 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-4f46102a-0b37-4705-8df1-ce8ad10a2895 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] 10.222.0.20 "GET /compute/v2.1/servers/c6c3c1ea-31e8-4c65-b73d-669f337bee2f" status: 200 len: 1734 microversion: 2.1 time: 0.151672 Jul 05 20:58:01.959897 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 221/452] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:58:01 2022] GET /compute/v2.1/servers/c6c3c1ea-31e8-4c65-b73d-669f337bee2f => generated 1734 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 20:58:02.977433 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-b7f267e5-d050-44f4-bc23-4c610d5c58e4 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:58:02.978044 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-b7f267e5-d050-44f4-bc23-4c610d5c58e4 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] [instance: c6c3c1ea-31e8-4c65-b73d-669f337bee2f] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:58:02.985325 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-b7f267e5-d050-44f4-bc23-4c610d5c58e4 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:58:02.985772 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-b7f267e5-d050-44f4-bc23-4c610d5c58e4 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:58:02.986532 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-b7f267e5-d050-44f4-bc23-4c610d5c58e4 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:58:02.995401 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-b7f267e5-d050-44f4-bc23-4c610d5c58e4 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:58:02.995401 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG dbcounter [-] [117628] Writing DB stats nova_cell1:SELECT=87,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:58:03.130822 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-b7f267e5-d050-44f4-bc23-4c610d5c58e4 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd152763a64794301b21587ab2b395bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc6d47f96d17471d94367bc8f8a3e3f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:58:03.139117 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-b7f267e5-d050-44f4-bc23-4c610d5c58e4 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] 10.222.0.20 "GET /compute/v2.1/servers/c6c3c1ea-31e8-4c65-b73d-669f337bee2f" status: 200 len: 1734 microversion: 2.1 time: 0.165463 Jul 05 20:58:03.139692 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 232/453] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:58:02 2022] GET /compute/v2.1/servers/c6c3c1ea-31e8-4c65-b73d-669f337bee2f => generated 1734 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 20:58:03.199662 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-c8130a81-d79c-4292-84df-d7b779d9f71e tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:58:03.201100 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-c8130a81-d79c-4292-84df-d7b779d9f71e tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] [instance: f236112c-4649-478b-a626-b84f8ff1bfe9] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:58:03.208731 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-c8130a81-d79c-4292-84df-d7b779d9f71e tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:58:03.209213 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-c8130a81-d79c-4292-84df-d7b779d9f71e tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:58:03.209977 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-c8130a81-d79c-4292-84df-d7b779d9f71e tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:58:03.210413 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-c8130a81-d79c-4292-84df-d7b779d9f71e tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:58:03.349541 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.objects.instance [None req-c8130a81-d79c-4292-84df-d7b779d9f71e tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lazy-loading 'services' on Instance uuid f236112c-4649-478b-a626-b84f8ff1bfe9 {{(pid=117627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 05 20:58:03.465667 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-c8130a81-d79c-4292-84df-d7b779d9f71e tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] 10.222.0.20 "DELETE /compute/v2.1/servers/f236112c-4649-478b-a626-b84f8ff1bfe9/os-volume_attachments/b424f0cb-3204-41fa-84b5-457d772502f2" status: 202 len: 0 microversion: 2.1 time: 0.270866 Jul 05 20:58:03.466249 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 222/454] 10.222.0.20 () {58 vars in 1415 bytes} [Tue Jul 5 20:58:03 2022] DELETE /compute/v2.1/servers/f236112c-4649-478b-a626-b84f8ff1bfe9/os-volume_attachments/b424f0cb-3204-41fa-84b5-457d772502f2 => generated 0 bytes in 273 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 05 20:58:04.156036 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-cf911e5f-c442-4331-a698-9476f122efda tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:58:04.156633 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-cf911e5f-c442-4331-a698-9476f122efda tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] [instance: c6c3c1ea-31e8-4c65-b73d-669f337bee2f] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:58:04.163018 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-cf911e5f-c442-4331-a698-9476f122efda tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:58:04.163461 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-cf911e5f-c442-4331-a698-9476f122efda tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:58:04.164205 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-cf911e5f-c442-4331-a698-9476f122efda tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:58:04.164637 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-cf911e5f-c442-4331-a698-9476f122efda tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:58:04.299477 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-cf911e5f-c442-4331-a698-9476f122efda tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd152763a64794301b21587ab2b395bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc6d47f96d17471d94367bc8f8a3e3f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:58:04.307761 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-cf911e5f-c442-4331-a698-9476f122efda tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] 10.222.0.20 "GET /compute/v2.1/servers/c6c3c1ea-31e8-4c65-b73d-669f337bee2f" status: 200 len: 1734 microversion: 2.1 time: 0.155496 Jul 05 20:58:04.308461 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 233/455] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:58:04 2022] GET /compute/v2.1/servers/c6c3c1ea-31e8-4c65-b73d-669f337bee2f => generated 1734 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 20:58:04.580961 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-60c0f8e5-4eb2-48d2-b9dc-f72e78cde98a tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 20:58:04.588233 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-60c0f8e5-4eb2-48d2-b9dc-f72e78cde98a tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:58:04.588677 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-60c0f8e5-4eb2-48d2-b9dc-f72e78cde98a tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:58:04.612214 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-60c0f8e5-4eb2-48d2-b9dc-f72e78cde98a tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] [instance: f236112c-4649-478b-a626-b84f8ff1bfe9] Going to try to stop instance {{(pid=117627) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 05 20:58:04.656640 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-60c0f8e5-4eb2-48d2-b9dc-f72e78cde98a tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] 10.222.0.20 "POST /compute/v2.1/servers/f236112c-4649-478b-a626-b84f8ff1bfe9/action" status: 202 len: 0 microversion: 2.1 time: 0.080038 Jul 05 20:58:04.657293 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 223/456] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Jul 5 20:58:04 2022] POST /compute/v2.1/servers/f236112c-4649-478b-a626-b84f8ff1bfe9/action => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 05 20:58:04.665230 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-bd0edae2-c51d-48c2-b2f1-1f0131bc5076 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:58:04.665910 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-bd0edae2-c51d-48c2-b2f1-1f0131bc5076 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] [instance: f236112c-4649-478b-a626-b84f8ff1bfe9] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:58:04.672832 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-bd0edae2-c51d-48c2-b2f1-1f0131bc5076 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:58:04.673538 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-bd0edae2-c51d-48c2-b2f1-1f0131bc5076 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:58:04.674378 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-bd0edae2-c51d-48c2-b2f1-1f0131bc5076 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:58:04.674890 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-bd0edae2-c51d-48c2-b2f1-1f0131bc5076 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:58:04.817985 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-bd0edae2-c51d-48c2-b2f1-1f0131bc5076 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eac41ce3f04450b840cff305ec1a5ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47e1ad014d542f98f6b24c8a504d166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:58:04.826263 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-bd0edae2-c51d-48c2-b2f1-1f0131bc5076 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] 10.222.0.20 "GET /compute/v2.1/servers/f236112c-4649-478b-a626-b84f8ff1bfe9" status: 200 len: 1676 microversion: 2.1 time: 0.164293 Jul 05 20:58:04.827629 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 234/457] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:58:04 2022] GET /compute/v2.1/servers/f236112c-4649-478b-a626-b84f8ff1bfe9 => generated 1676 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 20:58:05.324770 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-a97d2394-7528-415a-8d1e-1fa0884aa647 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:58:05.325606 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-a97d2394-7528-415a-8d1e-1fa0884aa647 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] [instance: c6c3c1ea-31e8-4c65-b73d-669f337bee2f] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:58:05.331791 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-a97d2394-7528-415a-8d1e-1fa0884aa647 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:58:05.332239 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-a97d2394-7528-415a-8d1e-1fa0884aa647 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:58:05.333026 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-a97d2394-7528-415a-8d1e-1fa0884aa647 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:58:05.333465 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-a97d2394-7528-415a-8d1e-1fa0884aa647 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:58:05.462215 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-a97d2394-7528-415a-8d1e-1fa0884aa647 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd152763a64794301b21587ab2b395bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc6d47f96d17471d94367bc8f8a3e3f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:58:05.470976 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-a97d2394-7528-415a-8d1e-1fa0884aa647 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] 10.222.0.20 "GET /compute/v2.1/servers/c6c3c1ea-31e8-4c65-b73d-669f337bee2f" status: 200 len: 1734 microversion: 2.1 time: 0.151108 Jul 05 20:58:05.471539 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 224/458] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:58:05 2022] GET /compute/v2.1/servers/c6c3c1ea-31e8-4c65-b73d-669f337bee2f => generated 1734 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 20:58:05.843928 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-38e5d418-bf08-4316-b915-1c891afd529a tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:58:05.844530 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-38e5d418-bf08-4316-b915-1c891afd529a tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] [instance: f236112c-4649-478b-a626-b84f8ff1bfe9] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:58:05.850972 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-38e5d418-bf08-4316-b915-1c891afd529a tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:58:05.851418 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-38e5d418-bf08-4316-b915-1c891afd529a tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:58:05.852188 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-38e5d418-bf08-4316-b915-1c891afd529a tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:58:05.852626 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-38e5d418-bf08-4316-b915-1c891afd529a tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:58:05.986628 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-38e5d418-bf08-4316-b915-1c891afd529a tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eac41ce3f04450b840cff305ec1a5ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47e1ad014d542f98f6b24c8a504d166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:58:05.994217 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-38e5d418-bf08-4316-b915-1c891afd529a tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] 10.222.0.20 "GET /compute/v2.1/servers/f236112c-4649-478b-a626-b84f8ff1bfe9" status: 200 len: 1676 microversion: 2.1 time: 0.154250 Jul 05 20:58:05.995593 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 235/459] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:58:05 2022] GET /compute/v2.1/servers/f236112c-4649-478b-a626-b84f8ff1bfe9 => generated 1676 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 20:58:06.488124 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-f4b49958-6c8e-435f-b5a5-21618dd3841b tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:58:06.488732 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-f4b49958-6c8e-435f-b5a5-21618dd3841b tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] [instance: c6c3c1ea-31e8-4c65-b73d-669f337bee2f] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:58:06.495469 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-f4b49958-6c8e-435f-b5a5-21618dd3841b tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:58:06.495916 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-f4b49958-6c8e-435f-b5a5-21618dd3841b tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:58:06.496679 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-f4b49958-6c8e-435f-b5a5-21618dd3841b tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:58:06.497154 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-f4b49958-6c8e-435f-b5a5-21618dd3841b tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:58:06.636340 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-f4b49958-6c8e-435f-b5a5-21618dd3841b tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd152763a64794301b21587ab2b395bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc6d47f96d17471d94367bc8f8a3e3f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:58:06.644543 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-f4b49958-6c8e-435f-b5a5-21618dd3841b tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] 10.222.0.20 "GET /compute/v2.1/servers/c6c3c1ea-31e8-4c65-b73d-669f337bee2f" status: 200 len: 1734 microversion: 2.1 time: 0.160272 Jul 05 20:58:06.645161 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 225/460] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:58:06 2022] GET /compute/v2.1/servers/c6c3c1ea-31e8-4c65-b73d-669f337bee2f => generated 1734 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 20:58:07.013315 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-53f300bc-f2e7-4ef9-9019-0ab9eb14f97c tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:58:07.013923 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-53f300bc-f2e7-4ef9-9019-0ab9eb14f97c tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] [instance: f236112c-4649-478b-a626-b84f8ff1bfe9] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:58:07.020511 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-53f300bc-f2e7-4ef9-9019-0ab9eb14f97c tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:58:07.020901 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-53f300bc-f2e7-4ef9-9019-0ab9eb14f97c tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:58:07.021685 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-53f300bc-f2e7-4ef9-9019-0ab9eb14f97c tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:58:07.022341 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-53f300bc-f2e7-4ef9-9019-0ab9eb14f97c tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:58:07.153309 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-53f300bc-f2e7-4ef9-9019-0ab9eb14f97c tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eac41ce3f04450b840cff305ec1a5ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47e1ad014d542f98f6b24c8a504d166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:58:07.160832 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-53f300bc-f2e7-4ef9-9019-0ab9eb14f97c tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] 10.222.0.20 "GET /compute/v2.1/servers/f236112c-4649-478b-a626-b84f8ff1bfe9" status: 200 len: 1676 microversion: 2.1 time: 0.152451 Jul 05 20:58:07.161435 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 236/461] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:58:07 2022] GET /compute/v2.1/servers/f236112c-4649-478b-a626-b84f8ff1bfe9 => generated 1676 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 20:58:07.662099 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-ded37b6e-23c0-42cc-8dd4-123dc22dc520 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:58:07.662679 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-ded37b6e-23c0-42cc-8dd4-123dc22dc520 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] [instance: c6c3c1ea-31e8-4c65-b73d-669f337bee2f] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:58:07.669237 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-ded37b6e-23c0-42cc-8dd4-123dc22dc520 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:58:07.669678 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-ded37b6e-23c0-42cc-8dd4-123dc22dc520 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:58:07.670421 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-ded37b6e-23c0-42cc-8dd4-123dc22dc520 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:58:07.670846 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-ded37b6e-23c0-42cc-8dd4-123dc22dc520 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:58:07.804409 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-ded37b6e-23c0-42cc-8dd4-123dc22dc520 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd152763a64794301b21587ab2b395bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc6d47f96d17471d94367bc8f8a3e3f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:58:07.812822 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-ded37b6e-23c0-42cc-8dd4-123dc22dc520 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] 10.222.0.20 "GET /compute/v2.1/servers/c6c3c1ea-31e8-4c65-b73d-669f337bee2f" status: 200 len: 1734 microversion: 2.1 time: 0.154530 Jul 05 20:58:07.813402 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 226/462] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:58:07 2022] GET /compute/v2.1/servers/c6c3c1ea-31e8-4c65-b73d-669f337bee2f => generated 1734 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 20:58:08.178327 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-7a86a60f-550b-477b-852c-b15e5c94f59c tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:58:08.178880 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-7a86a60f-550b-477b-852c-b15e5c94f59c tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] [instance: f236112c-4649-478b-a626-b84f8ff1bfe9] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:58:08.185958 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-7a86a60f-550b-477b-852c-b15e5c94f59c tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:58:08.186410 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-7a86a60f-550b-477b-852c-b15e5c94f59c tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:58:08.187177 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-7a86a60f-550b-477b-852c-b15e5c94f59c tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:58:08.187612 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-7a86a60f-550b-477b-852c-b15e5c94f59c tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:58:08.325542 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-7a86a60f-550b-477b-852c-b15e5c94f59c tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eac41ce3f04450b840cff305ec1a5ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47e1ad014d542f98f6b24c8a504d166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:58:08.333884 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-7a86a60f-550b-477b-852c-b15e5c94f59c tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] 10.222.0.20 "GET /compute/v2.1/servers/f236112c-4649-478b-a626-b84f8ff1bfe9" status: 200 len: 1676 microversion: 2.1 time: 0.159437 Jul 05 20:58:08.334454 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 237/463] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:58:08 2022] GET /compute/v2.1/servers/f236112c-4649-478b-a626-b84f8ff1bfe9 => generated 1676 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 20:58:08.829896 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-a340f378-647d-45fd-8876-f5871bb3f6d5 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:58:08.830500 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-a340f378-647d-45fd-8876-f5871bb3f6d5 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] [instance: c6c3c1ea-31e8-4c65-b73d-669f337bee2f] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:58:08.836890 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-a340f378-647d-45fd-8876-f5871bb3f6d5 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:58:08.837364 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-a340f378-647d-45fd-8876-f5871bb3f6d5 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:58:08.838284 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-a340f378-647d-45fd-8876-f5871bb3f6d5 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:58:08.838719 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-a340f378-647d-45fd-8876-f5871bb3f6d5 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:58:08.983448 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-a340f378-647d-45fd-8876-f5871bb3f6d5 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd152763a64794301b21587ab2b395bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc6d47f96d17471d94367bc8f8a3e3f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:58:08.991342 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-a340f378-647d-45fd-8876-f5871bb3f6d5 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] 10.222.0.20 "GET /compute/v2.1/servers/c6c3c1ea-31e8-4c65-b73d-669f337bee2f" status: 200 len: 1734 microversion: 2.1 time: 0.165128 Jul 05 20:58:08.991976 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 227/464] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:58:08 2022] GET /compute/v2.1/servers/c6c3c1ea-31e8-4c65-b73d-669f337bee2f => generated 1734 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 20:58:09.350351 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-99819e8f-7b9f-4818-b455-12e74a6b522f tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:58:09.351072 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-99819e8f-7b9f-4818-b455-12e74a6b522f tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] [instance: f236112c-4649-478b-a626-b84f8ff1bfe9] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:58:09.359012 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-99819e8f-7b9f-4818-b455-12e74a6b522f tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:58:09.359463 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-99819e8f-7b9f-4818-b455-12e74a6b522f tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:58:09.360226 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-99819e8f-7b9f-4818-b455-12e74a6b522f tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:58:09.360664 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-99819e8f-7b9f-4818-b455-12e74a6b522f tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:58:09.499389 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-99819e8f-7b9f-4818-b455-12e74a6b522f tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eac41ce3f04450b840cff305ec1a5ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47e1ad014d542f98f6b24c8a504d166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:58:09.507291 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-99819e8f-7b9f-4818-b455-12e74a6b522f tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] 10.222.0.20 "GET /compute/v2.1/servers/f236112c-4649-478b-a626-b84f8ff1bfe9" status: 200 len: 1676 microversion: 2.1 time: 0.161108 Jul 05 20:58:09.507881 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 238/465] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:58:09 2022] GET /compute/v2.1/servers/f236112c-4649-478b-a626-b84f8ff1bfe9 => generated 1676 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 20:58:10.009111 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-b1a8fcf4-77e8-4166-bc7c-77ab2134c91f tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:58:10.009749 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-b1a8fcf4-77e8-4166-bc7c-77ab2134c91f tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] [instance: c6c3c1ea-31e8-4c65-b73d-669f337bee2f] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:58:10.016548 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-b1a8fcf4-77e8-4166-bc7c-77ab2134c91f tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:58:10.017084 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-b1a8fcf4-77e8-4166-bc7c-77ab2134c91f tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:58:10.017782 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-b1a8fcf4-77e8-4166-bc7c-77ab2134c91f tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:58:10.018214 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-b1a8fcf4-77e8-4166-bc7c-77ab2134c91f tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:58:10.153851 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-b1a8fcf4-77e8-4166-bc7c-77ab2134c91f tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd152763a64794301b21587ab2b395bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc6d47f96d17471d94367bc8f8a3e3f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:58:10.161748 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-b1a8fcf4-77e8-4166-bc7c-77ab2134c91f tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] 10.222.0.20 "GET /compute/v2.1/servers/c6c3c1ea-31e8-4c65-b73d-669f337bee2f" status: 200 len: 1734 microversion: 2.1 time: 0.156552 Jul 05 20:58:10.162315 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 228/466] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:58:10 2022] GET /compute/v2.1/servers/c6c3c1ea-31e8-4c65-b73d-669f337bee2f => generated 1734 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 20:58:10.524831 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-2d612a7a-5bc6-46f5-a40b-21aa82308c95 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:58:10.526167 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-2d612a7a-5bc6-46f5-a40b-21aa82308c95 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] [instance: f236112c-4649-478b-a626-b84f8ff1bfe9] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:58:10.532608 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-2d612a7a-5bc6-46f5-a40b-21aa82308c95 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:58:10.533092 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-2d612a7a-5bc6-46f5-a40b-21aa82308c95 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:58:10.533860 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-2d612a7a-5bc6-46f5-a40b-21aa82308c95 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:58:10.534297 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-2d612a7a-5bc6-46f5-a40b-21aa82308c95 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:58:10.679859 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-2d612a7a-5bc6-46f5-a40b-21aa82308c95 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eac41ce3f04450b840cff305ec1a5ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47e1ad014d542f98f6b24c8a504d166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:58:10.687685 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-2d612a7a-5bc6-46f5-a40b-21aa82308c95 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] 10.222.0.20 "GET /compute/v2.1/servers/f236112c-4649-478b-a626-b84f8ff1bfe9" status: 200 len: 1676 microversion: 2.1 time: 0.166881 Jul 05 20:58:10.688239 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 239/467] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:58:10 2022] GET /compute/v2.1/servers/f236112c-4649-478b-a626-b84f8ff1bfe9 => generated 1676 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 20:58:11.179642 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-4f280b84-8450-4fbc-ad18-96b832884b09 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:58:11.180241 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-4f280b84-8450-4fbc-ad18-96b832884b09 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] [instance: c6c3c1ea-31e8-4c65-b73d-669f337bee2f] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:58:11.187424 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-4f280b84-8450-4fbc-ad18-96b832884b09 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:58:11.187863 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-4f280b84-8450-4fbc-ad18-96b832884b09 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:58:11.188602 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-4f280b84-8450-4fbc-ad18-96b832884b09 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:58:11.189057 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-4f280b84-8450-4fbc-ad18-96b832884b09 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:58:11.317228 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-4f280b84-8450-4fbc-ad18-96b832884b09 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd152763a64794301b21587ab2b395bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc6d47f96d17471d94367bc8f8a3e3f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:58:11.325552 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-4f280b84-8450-4fbc-ad18-96b832884b09 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] 10.222.0.20 "GET /compute/v2.1/servers/c6c3c1ea-31e8-4c65-b73d-669f337bee2f" status: 200 len: 1734 microversion: 2.1 time: 0.149731 Jul 05 20:58:11.326115 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 229/468] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:58:11 2022] GET /compute/v2.1/servers/c6c3c1ea-31e8-4c65-b73d-669f337bee2f => generated 1734 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 20:58:11.705141 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-55ff7fba-1283-43d2-8dbd-358e8d868430 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:58:11.705816 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-55ff7fba-1283-43d2-8dbd-358e8d868430 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] [instance: f236112c-4649-478b-a626-b84f8ff1bfe9] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:58:11.712212 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-55ff7fba-1283-43d2-8dbd-358e8d868430 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:58:11.712651 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-55ff7fba-1283-43d2-8dbd-358e8d868430 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:58:11.713427 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-55ff7fba-1283-43d2-8dbd-358e8d868430 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:58:11.713904 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-55ff7fba-1283-43d2-8dbd-358e8d868430 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:58:11.840731 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-55ff7fba-1283-43d2-8dbd-358e8d868430 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eac41ce3f04450b840cff305ec1a5ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47e1ad014d542f98f6b24c8a504d166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:58:11.848236 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-55ff7fba-1283-43d2-8dbd-358e8d868430 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] 10.222.0.20 "GET /compute/v2.1/servers/f236112c-4649-478b-a626-b84f8ff1bfe9" status: 200 len: 1676 microversion: 2.1 time: 0.146905 Jul 05 20:58:11.848793 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 240/469] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:58:11 2022] GET /compute/v2.1/servers/f236112c-4649-478b-a626-b84f8ff1bfe9 => generated 1676 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 20:58:12.342746 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-75325500-90c4-4d68-8a0a-c793faffbf43 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:58:12.343327 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-75325500-90c4-4d68-8a0a-c793faffbf43 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] [instance: c6c3c1ea-31e8-4c65-b73d-669f337bee2f] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:58:12.349818 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-75325500-90c4-4d68-8a0a-c793faffbf43 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:58:12.350304 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-75325500-90c4-4d68-8a0a-c793faffbf43 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:58:12.351056 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-75325500-90c4-4d68-8a0a-c793faffbf43 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:58:12.351485 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-75325500-90c4-4d68-8a0a-c793faffbf43 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:58:12.481790 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-75325500-90c4-4d68-8a0a-c793faffbf43 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd152763a64794301b21587ab2b395bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc6d47f96d17471d94367bc8f8a3e3f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:58:12.489653 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-75325500-90c4-4d68-8a0a-c793faffbf43 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] 10.222.0.20 "GET /compute/v2.1/servers/c6c3c1ea-31e8-4c65-b73d-669f337bee2f" status: 200 len: 1734 microversion: 2.1 time: 0.151057 Jul 05 20:58:12.490205 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 230/470] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:58:12 2022] GET /compute/v2.1/servers/c6c3c1ea-31e8-4c65-b73d-669f337bee2f => generated 1734 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 20:58:12.866444 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-5a319d4c-ac02-4af0-9865-dd2f5664a943 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:58:12.867031 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-5a319d4c-ac02-4af0-9865-dd2f5664a943 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] [instance: f236112c-4649-478b-a626-b84f8ff1bfe9] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:58:12.877057 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-5a319d4c-ac02-4af0-9865-dd2f5664a943 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:58:12.877587 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-5a319d4c-ac02-4af0-9865-dd2f5664a943 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:58:12.878479 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-5a319d4c-ac02-4af0-9865-dd2f5664a943 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:58:12.878955 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-5a319d4c-ac02-4af0-9865-dd2f5664a943 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:58:13.023712 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-5a319d4c-ac02-4af0-9865-dd2f5664a943 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eac41ce3f04450b840cff305ec1a5ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47e1ad014d542f98f6b24c8a504d166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:58:13.032182 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-5a319d4c-ac02-4af0-9865-dd2f5664a943 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] 10.222.0.20 "GET /compute/v2.1/servers/f236112c-4649-478b-a626-b84f8ff1bfe9" status: 200 len: 1676 microversion: 2.1 time: 0.169585 Jul 05 20:58:13.032747 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 241/471] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:58:12 2022] GET /compute/v2.1/servers/f236112c-4649-478b-a626-b84f8ff1bfe9 => generated 1676 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 20:58:13.506941 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-c4933792-ac5a-4cca-b7b5-0a402f95b3ac tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:58:13.507554 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-c4933792-ac5a-4cca-b7b5-0a402f95b3ac tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] [instance: c6c3c1ea-31e8-4c65-b73d-669f337bee2f] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:58:13.514774 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-c4933792-ac5a-4cca-b7b5-0a402f95b3ac tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:58:13.515220 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-c4933792-ac5a-4cca-b7b5-0a402f95b3ac tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:58:13.515977 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-c4933792-ac5a-4cca-b7b5-0a402f95b3ac tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:58:13.516409 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-c4933792-ac5a-4cca-b7b5-0a402f95b3ac tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:58:13.645760 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-c4933792-ac5a-4cca-b7b5-0a402f95b3ac tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd152763a64794301b21587ab2b395bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc6d47f96d17471d94367bc8f8a3e3f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:58:13.655735 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-c4933792-ac5a-4cca-b7b5-0a402f95b3ac tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] 10.222.0.20 "GET /compute/v2.1/servers/c6c3c1ea-31e8-4c65-b73d-669f337bee2f" status: 200 len: 1734 microversion: 2.1 time: 0.152836 Jul 05 20:58:13.656637 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 231/472] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:58:13 2022] GET /compute/v2.1/servers/c6c3c1ea-31e8-4c65-b73d-669f337bee2f => generated 1734 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 20:58:14.051654 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-ca164989-c0db-4c36-903c-bb1a3262cea5 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:58:14.052264 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-ca164989-c0db-4c36-903c-bb1a3262cea5 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] [instance: f236112c-4649-478b-a626-b84f8ff1bfe9] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:58:14.059732 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-ca164989-c0db-4c36-903c-bb1a3262cea5 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:58:14.060182 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-ca164989-c0db-4c36-903c-bb1a3262cea5 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:58:14.060965 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-ca164989-c0db-4c36-903c-bb1a3262cea5 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:58:14.061405 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-ca164989-c0db-4c36-903c-bb1a3262cea5 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:58:14.195484 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-ca164989-c0db-4c36-903c-bb1a3262cea5 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eac41ce3f04450b840cff305ec1a5ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47e1ad014d542f98f6b24c8a504d166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:58:14.203095 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-ca164989-c0db-4c36-903c-bb1a3262cea5 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] 10.222.0.20 "GET /compute/v2.1/servers/f236112c-4649-478b-a626-b84f8ff1bfe9" status: 200 len: 1676 microversion: 2.1 time: 0.155272 Jul 05 20:58:14.203661 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 242/473] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:58:14 2022] GET /compute/v2.1/servers/f236112c-4649-478b-a626-b84f8ff1bfe9 => generated 1676 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 20:58:14.673147 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-7fa3e011-96f9-4661-8771-a0126967ea79 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:58:14.673758 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-7fa3e011-96f9-4661-8771-a0126967ea79 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] [instance: c6c3c1ea-31e8-4c65-b73d-669f337bee2f] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:58:14.680231 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-7fa3e011-96f9-4661-8771-a0126967ea79 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:58:14.680675 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-7fa3e011-96f9-4661-8771-a0126967ea79 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:58:14.681452 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-7fa3e011-96f9-4661-8771-a0126967ea79 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:58:14.681884 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-7fa3e011-96f9-4661-8771-a0126967ea79 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:58:14.814590 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-7fa3e011-96f9-4661-8771-a0126967ea79 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd152763a64794301b21587ab2b395bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc6d47f96d17471d94367bc8f8a3e3f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:58:14.822517 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-7fa3e011-96f9-4661-8771-a0126967ea79 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] 10.222.0.20 "GET /compute/v2.1/servers/c6c3c1ea-31e8-4c65-b73d-669f337bee2f" status: 200 len: 1734 microversion: 2.1 time: 0.153216 Jul 05 20:58:14.823716 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 232/474] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:58:14 2022] GET /compute/v2.1/servers/c6c3c1ea-31e8-4c65-b73d-669f337bee2f => generated 1734 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 20:58:15.220509 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-bcd0cb7f-e66a-4a39-b84e-d0d1c41a7864 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:58:15.221196 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-bcd0cb7f-e66a-4a39-b84e-d0d1c41a7864 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] [instance: f236112c-4649-478b-a626-b84f8ff1bfe9] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:58:15.227788 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-bcd0cb7f-e66a-4a39-b84e-d0d1c41a7864 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:58:15.228236 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-bcd0cb7f-e66a-4a39-b84e-d0d1c41a7864 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:58:15.229056 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-bcd0cb7f-e66a-4a39-b84e-d0d1c41a7864 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:58:15.229825 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-bcd0cb7f-e66a-4a39-b84e-d0d1c41a7864 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:58:15.360176 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-bcd0cb7f-e66a-4a39-b84e-d0d1c41a7864 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eac41ce3f04450b840cff305ec1a5ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47e1ad014d542f98f6b24c8a504d166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:58:15.367696 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-bcd0cb7f-e66a-4a39-b84e-d0d1c41a7864 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] 10.222.0.20 "GET /compute/v2.1/servers/f236112c-4649-478b-a626-b84f8ff1bfe9" status: 200 len: 1676 microversion: 2.1 time: 0.151005 Jul 05 20:58:15.368288 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 243/475] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:58:15 2022] GET /compute/v2.1/servers/f236112c-4649-478b-a626-b84f8ff1bfe9 => generated 1676 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 20:58:15.842642 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-d97db791-0017-46b1-9722-b312c7506adf tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:58:15.843284 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-d97db791-0017-46b1-9722-b312c7506adf tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] [instance: c6c3c1ea-31e8-4c65-b73d-669f337bee2f] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:58:15.849925 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-d97db791-0017-46b1-9722-b312c7506adf tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:58:15.850374 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-d97db791-0017-46b1-9722-b312c7506adf tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:58:15.851137 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-d97db791-0017-46b1-9722-b312c7506adf tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:58:15.851570 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-d97db791-0017-46b1-9722-b312c7506adf tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:58:15.980075 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-d97db791-0017-46b1-9722-b312c7506adf tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd152763a64794301b21587ab2b395bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc6d47f96d17471d94367bc8f8a3e3f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:58:15.987951 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-d97db791-0017-46b1-9722-b312c7506adf tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] 10.222.0.20 "GET /compute/v2.1/servers/c6c3c1ea-31e8-4c65-b73d-669f337bee2f" status: 200 len: 1734 microversion: 2.1 time: 0.149217 Jul 05 20:58:15.988506 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 233/476] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:58:15 2022] GET /compute/v2.1/servers/c6c3c1ea-31e8-4c65-b73d-669f337bee2f => generated 1734 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 20:58:16.384986 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-53bf5e92-3545-4423-b9ba-fe7041ab0f6d tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:58:16.386131 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-53bf5e92-3545-4423-b9ba-fe7041ab0f6d tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] [instance: f236112c-4649-478b-a626-b84f8ff1bfe9] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:58:16.393226 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-53bf5e92-3545-4423-b9ba-fe7041ab0f6d tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:58:16.393693 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-53bf5e92-3545-4423-b9ba-fe7041ab0f6d tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:58:16.394440 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-53bf5e92-3545-4423-b9ba-fe7041ab0f6d tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:58:16.394873 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-53bf5e92-3545-4423-b9ba-fe7041ab0f6d tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:58:16.527649 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-53bf5e92-3545-4423-b9ba-fe7041ab0f6d tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eac41ce3f04450b840cff305ec1a5ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47e1ad014d542f98f6b24c8a504d166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:58:16.535148 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-53bf5e92-3545-4423-b9ba-fe7041ab0f6d tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] 10.222.0.20 "GET /compute/v2.1/servers/f236112c-4649-478b-a626-b84f8ff1bfe9" status: 200 len: 1676 microversion: 2.1 time: 0.153997 Jul 05 20:58:16.535720 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 244/477] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:58:16 2022] GET /compute/v2.1/servers/f236112c-4649-478b-a626-b84f8ff1bfe9 => generated 1676 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 20:58:17.004334 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-dfc464bf-fdf2-434d-9d2e-8872e8b2a8cd tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:58:17.004960 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-dfc464bf-fdf2-434d-9d2e-8872e8b2a8cd tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] [instance: c6c3c1ea-31e8-4c65-b73d-669f337bee2f] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:58:17.012023 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-dfc464bf-fdf2-434d-9d2e-8872e8b2a8cd tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:58:17.012462 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-dfc464bf-fdf2-434d-9d2e-8872e8b2a8cd tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:58:17.013229 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-dfc464bf-fdf2-434d-9d2e-8872e8b2a8cd tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:58:17.013659 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-dfc464bf-fdf2-434d-9d2e-8872e8b2a8cd tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:58:17.148914 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-dfc464bf-fdf2-434d-9d2e-8872e8b2a8cd tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd152763a64794301b21587ab2b395bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc6d47f96d17471d94367bc8f8a3e3f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:58:17.156973 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-dfc464bf-fdf2-434d-9d2e-8872e8b2a8cd tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] 10.222.0.20 "GET /compute/v2.1/servers/c6c3c1ea-31e8-4c65-b73d-669f337bee2f" status: 200 len: 1734 microversion: 2.1 time: 0.156333 Jul 05 20:58:17.157529 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 234/478] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:58:16 2022] GET /compute/v2.1/servers/c6c3c1ea-31e8-4c65-b73d-669f337bee2f => generated 1734 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 20:58:17.551606 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-f2026d98-a4cd-4082-a7cb-440c885b8330 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:58:17.552213 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-f2026d98-a4cd-4082-a7cb-440c885b8330 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] [instance: f236112c-4649-478b-a626-b84f8ff1bfe9] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:58:17.558804 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-f2026d98-a4cd-4082-a7cb-440c885b8330 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:58:17.559251 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-f2026d98-a4cd-4082-a7cb-440c885b8330 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:58:17.560004 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-f2026d98-a4cd-4082-a7cb-440c885b8330 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:58:17.560438 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-f2026d98-a4cd-4082-a7cb-440c885b8330 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:58:17.690009 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-f2026d98-a4cd-4082-a7cb-440c885b8330 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eac41ce3f04450b840cff305ec1a5ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47e1ad014d542f98f6b24c8a504d166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:58:17.697447 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-f2026d98-a4cd-4082-a7cb-440c885b8330 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] 10.222.0.20 "GET /compute/v2.1/servers/f236112c-4649-478b-a626-b84f8ff1bfe9" status: 200 len: 1653 microversion: 2.1 time: 0.149752 Jul 05 20:58:17.698222 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 245/479] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:58:17 2022] GET /compute/v2.1/servers/f236112c-4649-478b-a626-b84f8ff1bfe9 => generated 1653 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 20:58:17.714186 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-80efde1a-ffd2-49af-b237-90adb329bd4b tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 20:58:17.720238 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-80efde1a-ffd2-49af-b237-90adb329bd4b tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:58:17.720683 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-80efde1a-ffd2-49af-b237-90adb329bd4b tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:58:17.742365 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-80efde1a-ffd2-49af-b237-90adb329bd4b tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] [instance: f236112c-4649-478b-a626-b84f8ff1bfe9] Going to try to start instance {{(pid=117627) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 05 20:58:17.755744 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG dbcounter [-] [117627] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:58:17.785944 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-80efde1a-ffd2-49af-b237-90adb329bd4b tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] 10.222.0.20 "POST /compute/v2.1/servers/f236112c-4649-478b-a626-b84f8ff1bfe9/action" status: 202 len: 0 microversion: 2.1 time: 0.075880 Jul 05 20:58:17.786548 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 235/480] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Jul 5 20:58:17 2022] POST /compute/v2.1/servers/f236112c-4649-478b-a626-b84f8ff1bfe9/action => generated 0 bytes in 77 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 05 20:58:17.795048 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-4ba59f59-d572-4ef6-bce3-45e80c296b5d tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:58:17.795656 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-4ba59f59-d572-4ef6-bce3-45e80c296b5d tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] [instance: f236112c-4649-478b-a626-b84f8ff1bfe9] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:58:17.801782 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-4ba59f59-d572-4ef6-bce3-45e80c296b5d tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:58:17.802165 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-4ba59f59-d572-4ef6-bce3-45e80c296b5d tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:58:17.802920 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-4ba59f59-d572-4ef6-bce3-45e80c296b5d tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:58:17.803352 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-4ba59f59-d572-4ef6-bce3-45e80c296b5d tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:58:17.943754 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-4ba59f59-d572-4ef6-bce3-45e80c296b5d tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eac41ce3f04450b840cff305ec1a5ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47e1ad014d542f98f6b24c8a504d166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:58:17.952136 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-4ba59f59-d572-4ef6-bce3-45e80c296b5d tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] 10.222.0.20 "GET /compute/v2.1/servers/f236112c-4649-478b-a626-b84f8ff1bfe9" status: 200 len: 1662 microversion: 2.1 time: 0.161481 Jul 05 20:58:17.952699 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 246/481] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:58:17 2022] GET /compute/v2.1/servers/f236112c-4649-478b-a626-b84f8ff1bfe9 => generated 1662 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 20:58:18.174846 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-c5bdfd5f-ab68-4290-810d-d1b1ae36eb77 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:58:18.175757 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-c5bdfd5f-ab68-4290-810d-d1b1ae36eb77 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] [instance: c6c3c1ea-31e8-4c65-b73d-669f337bee2f] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:58:18.183636 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-c5bdfd5f-ab68-4290-810d-d1b1ae36eb77 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:58:18.184141 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-c5bdfd5f-ab68-4290-810d-d1b1ae36eb77 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:58:18.185023 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-c5bdfd5f-ab68-4290-810d-d1b1ae36eb77 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:58:18.185482 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-c5bdfd5f-ab68-4290-810d-d1b1ae36eb77 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:58:18.326925 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-c5bdfd5f-ab68-4290-810d-d1b1ae36eb77 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd152763a64794301b21587ab2b395bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc6d47f96d17471d94367bc8f8a3e3f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:58:18.335760 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-c5bdfd5f-ab68-4290-810d-d1b1ae36eb77 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] 10.222.0.20 "GET /compute/v2.1/servers/c6c3c1ea-31e8-4c65-b73d-669f337bee2f" status: 200 len: 1734 microversion: 2.1 time: 0.165490 Jul 05 20:58:18.336257 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 236/482] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:58:18 2022] GET /compute/v2.1/servers/c6c3c1ea-31e8-4c65-b73d-669f337bee2f => generated 1734 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 20:58:18.969647 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-b8983e86-bb98-4096-8b8e-d7bb489699c1 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:58:18.970333 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-b8983e86-bb98-4096-8b8e-d7bb489699c1 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] [instance: f236112c-4649-478b-a626-b84f8ff1bfe9] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:58:18.976758 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-b8983e86-bb98-4096-8b8e-d7bb489699c1 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:58:18.977231 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-b8983e86-bb98-4096-8b8e-d7bb489699c1 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:58:18.977982 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-b8983e86-bb98-4096-8b8e-d7bb489699c1 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:58:18.978406 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-b8983e86-bb98-4096-8b8e-d7bb489699c1 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:58:19.110522 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-b8983e86-bb98-4096-8b8e-d7bb489699c1 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eac41ce3f04450b840cff305ec1a5ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47e1ad014d542f98f6b24c8a504d166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:58:19.118039 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-b8983e86-bb98-4096-8b8e-d7bb489699c1 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] 10.222.0.20 "GET /compute/v2.1/servers/f236112c-4649-478b-a626-b84f8ff1bfe9" status: 200 len: 1662 microversion: 2.1 time: 0.152313 Jul 05 20:58:19.118594 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 247/483] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:58:18 2022] GET /compute/v2.1/servers/f236112c-4649-478b-a626-b84f8ff1bfe9 => generated 1662 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 20:58:19.353152 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-b5a46a9c-690d-4072-b21f-44c8b3bfdd44 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:58:19.353794 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-b5a46a9c-690d-4072-b21f-44c8b3bfdd44 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] [instance: c6c3c1ea-31e8-4c65-b73d-669f337bee2f] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:58:19.361630 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-b5a46a9c-690d-4072-b21f-44c8b3bfdd44 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:58:19.362074 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-b5a46a9c-690d-4072-b21f-44c8b3bfdd44 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:58:19.362827 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-b5a46a9c-690d-4072-b21f-44c8b3bfdd44 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:58:19.363253 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-b5a46a9c-690d-4072-b21f-44c8b3bfdd44 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:58:19.507328 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-b5a46a9c-690d-4072-b21f-44c8b3bfdd44 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd152763a64794301b21587ab2b395bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc6d47f96d17471d94367bc8f8a3e3f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:58:19.516437 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-b5a46a9c-690d-4072-b21f-44c8b3bfdd44 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] 10.222.0.20 "GET /compute/v2.1/servers/c6c3c1ea-31e8-4c65-b73d-669f337bee2f" status: 200 len: 1734 microversion: 2.1 time: 0.167479 Jul 05 20:58:19.517175 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 237/484] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:58:19 2022] GET /compute/v2.1/servers/c6c3c1ea-31e8-4c65-b73d-669f337bee2f => generated 1734 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 20:58:20.135663 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-3c0b4eda-4931-43f2-999e-e3851bf2e83a tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:58:20.136256 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-3c0b4eda-4931-43f2-999e-e3851bf2e83a tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] [instance: f236112c-4649-478b-a626-b84f8ff1bfe9] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:58:20.142786 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-3c0b4eda-4931-43f2-999e-e3851bf2e83a tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:58:20.143222 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-3c0b4eda-4931-43f2-999e-e3851bf2e83a tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:58:20.143965 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-3c0b4eda-4931-43f2-999e-e3851bf2e83a tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:58:20.144396 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-3c0b4eda-4931-43f2-999e-e3851bf2e83a tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:58:20.285450 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-3c0b4eda-4931-43f2-999e-e3851bf2e83a tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eac41ce3f04450b840cff305ec1a5ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47e1ad014d542f98f6b24c8a504d166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:58:20.287777 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG dbcounter [-] [117628] Writing DB stats nova_cell1:SELECT=100 {{(pid=117628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:58:20.294801 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-3c0b4eda-4931-43f2-999e-e3851bf2e83a tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] 10.222.0.20 "GET /compute/v2.1/servers/f236112c-4649-478b-a626-b84f8ff1bfe9" status: 200 len: 1662 microversion: 2.1 time: 0.163147 Jul 05 20:58:20.295369 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 248/485] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:58:20 2022] GET /compute/v2.1/servers/f236112c-4649-478b-a626-b84f8ff1bfe9 => generated 1662 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 20:58:20.534695 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-edb74a0c-a7f8-4611-bdeb-fecd1fe0f329 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:58:20.535302 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-edb74a0c-a7f8-4611-bdeb-fecd1fe0f329 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] [instance: c6c3c1ea-31e8-4c65-b73d-669f337bee2f] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:58:20.542393 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-edb74a0c-a7f8-4611-bdeb-fecd1fe0f329 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:58:20.542840 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-edb74a0c-a7f8-4611-bdeb-fecd1fe0f329 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:58:20.543589 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-edb74a0c-a7f8-4611-bdeb-fecd1fe0f329 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:58:20.544019 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-edb74a0c-a7f8-4611-bdeb-fecd1fe0f329 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:58:20.671235 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-edb74a0c-a7f8-4611-bdeb-fecd1fe0f329 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd152763a64794301b21587ab2b395bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc6d47f96d17471d94367bc8f8a3e3f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:58:20.679177 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-edb74a0c-a7f8-4611-bdeb-fecd1fe0f329 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] 10.222.0.20 "GET /compute/v2.1/servers/c6c3c1ea-31e8-4c65-b73d-669f337bee2f" status: 200 len: 1734 microversion: 2.1 time: 0.148309 Jul 05 20:58:20.679739 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 238/486] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:58:20 2022] GET /compute/v2.1/servers/c6c3c1ea-31e8-4c65-b73d-669f337bee2f => generated 1734 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 20:58:21.314134 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-37d6e10b-6aa7-4166-be7e-b251dcc74e4a tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:58:21.314826 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-37d6e10b-6aa7-4166-be7e-b251dcc74e4a tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] [instance: f236112c-4649-478b-a626-b84f8ff1bfe9] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:58:21.323184 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-37d6e10b-6aa7-4166-be7e-b251dcc74e4a tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:58:21.323531 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-37d6e10b-6aa7-4166-be7e-b251dcc74e4a tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:58:21.324279 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-37d6e10b-6aa7-4166-be7e-b251dcc74e4a tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:58:21.324705 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-37d6e10b-6aa7-4166-be7e-b251dcc74e4a tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:58:21.458926 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-37d6e10b-6aa7-4166-be7e-b251dcc74e4a tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eac41ce3f04450b840cff305ec1a5ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47e1ad014d542f98f6b24c8a504d166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:58:21.467083 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-37d6e10b-6aa7-4166-be7e-b251dcc74e4a tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] 10.222.0.20 "GET /compute/v2.1/servers/f236112c-4649-478b-a626-b84f8ff1bfe9" status: 200 len: 1662 microversion: 2.1 time: 0.157806 Jul 05 20:58:21.467650 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 249/487] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:58:21 2022] GET /compute/v2.1/servers/f236112c-4649-478b-a626-b84f8ff1bfe9 => generated 1662 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 20:58:21.696720 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-ef8476a1-0a1f-40f8-b497-c66fb50a02d4 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:58:21.697309 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-ef8476a1-0a1f-40f8-b497-c66fb50a02d4 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] [instance: c6c3c1ea-31e8-4c65-b73d-669f337bee2f] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:58:21.704066 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-ef8476a1-0a1f-40f8-b497-c66fb50a02d4 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:58:21.704510 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-ef8476a1-0a1f-40f8-b497-c66fb50a02d4 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:58:21.705290 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-ef8476a1-0a1f-40f8-b497-c66fb50a02d4 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:58:21.705724 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-ef8476a1-0a1f-40f8-b497-c66fb50a02d4 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:58:21.900957 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-ef8476a1-0a1f-40f8-b497-c66fb50a02d4 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd152763a64794301b21587ab2b395bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc6d47f96d17471d94367bc8f8a3e3f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:58:21.909139 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-ef8476a1-0a1f-40f8-b497-c66fb50a02d4 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] 10.222.0.20 "GET /compute/v2.1/servers/c6c3c1ea-31e8-4c65-b73d-669f337bee2f" status: 200 len: 1714 microversion: 2.1 time: 0.216226 Jul 05 20:58:21.909719 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 239/488] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:58:21 2022] GET /compute/v2.1/servers/c6c3c1ea-31e8-4c65-b73d-669f337bee2f => generated 1714 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 20:58:22.015416 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-9daeac88-0afa-4022-a74d-b951202e266a tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:58:22.015899 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-9daeac88-0afa-4022-a74d-b951202e266a tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] [instance: c6c3c1ea-31e8-4c65-b73d-669f337bee2f] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:58:22.022166 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-9daeac88-0afa-4022-a74d-b951202e266a tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:58:22.022874 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-9daeac88-0afa-4022-a74d-b951202e266a tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:58:22.023641 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-9daeac88-0afa-4022-a74d-b951202e266a tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:58:22.024074 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-9daeac88-0afa-4022-a74d-b951202e266a tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:58:22.151051 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.wsgi [None req-9daeac88-0afa-4022-a74d-b951202e266a tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] HTTP exception thrown: Cannot 'detach_volume' instance c6c3c1ea-31e8-4c65-b73d-669f337bee2f while it is in vm_state rescued Jul 05 20:58:22.152725 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-9daeac88-0afa-4022-a74d-b951202e266a tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Request method failure captured: Jul 05 20:58:22.152725 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: request: DELETE /compute/v2.1/servers/c6c3c1ea-31e8-4c65-b73d-669f337bee2f/os-volume_attachments/f96cb636-9caf-4760-908c-b1b0f1b55a85 HTTP/1.1 Jul 05 20:58:22.152725 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: Accept: application/json Jul 05 20:58:22.152725 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: Accept-Encoding: identity Jul 05 20:58:22.152725 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: Connection: close Jul 05 20:58:22.152725 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: Content-Length: 0 Jul 05 20:58:22.152725 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: Content-Type: application/json Jul 05 20:58:22.152725 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: Host: 10.222.0.20 Jul 05 20:58:22.152725 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: Openstack-System-Scope: None Jul 05 20:58:22.152725 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: User-Agent: python-urllib3/1.26.9 Jul 05 20:58:22.152725 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Auth-Token: gAAAAABixKUPNuH34QdH2KDVfn6Xq2ExRJFV_gfDikdto6Gtv-4vxOCZQ-cLxCvkxKeLcktJgVnSU2DRVovOt1N1tNauQsWgnI_IcnWeNaI2cc_3sRiAXqXL8oS987NWbN-5be6gxd3B2gK8PLp16_Qnn5ivzsTuuUNEU8MMiW1aGUc2_5VIMUQ Jul 05 20:58:22.152725 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Domain-Id: None Jul 05 20:58:22.152725 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Domain-Name: None Jul 05 20:58:22.152725 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Identity-Status: Confirmed Jul 05 20:58:22.152725 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Is-Admin-Project: True Jul 05 20:58:22.152725 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Project-Domain-Id: default Jul 05 20:58:22.152725 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Project-Domain-Name: Default Jul 05 20:58:22.152725 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Project-Id: fc6d47f96d17471d94367bc8f8a3e3f6 Jul 05 20:58:22.152725 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1951132500 Jul 05 20:58:22.152725 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Role: member,reader Jul 05 20:58:22.152725 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Roles: member,reader Jul 05 20:58:22.154404 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/fc6d47f96d17471d94367bc8f8a3e3f6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/fc6d47f96d17471d94367bc8f8a3e3f6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_fc6d47f96d17471d94367bc8f8a3e3f6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/fc6d47f96d17471d94367bc8f8a3e3f6"}]}] Jul 05 20:58:22.154404 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1951132500 Jul 05 20:58:22.154404 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Tenant-Id: fc6d47f96d17471d94367bc8f8a3e3f6 Jul 05 20:58:22.154404 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1951132500 Jul 05 20:58:22.154404 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-User: tempest-ServerRescueNegativeTestJSON-1951132500-project Jul 05 20:58:22.154404 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-User-Domain-Id: default Jul 05 20:58:22.154404 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-User-Domain-Name: Default Jul 05 20:58:22.154404 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-User-Id: d152763a64794301b21587ab2b395bbf Jul 05 20:58:22.154404 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1951132500-project Jul 05 20:58:22.154404 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: method: > Jul 05 20:58:22.154404 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: exception: Cannot 'detach_volume' instance c6c3c1ea-31e8-4c65-b73d-669f337bee2f while it is in vm_state rescued Jul 05 20:58:22.155312 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: action_args: {'server_id': 'c6c3c1ea-31e8-4c65-b73d-669f337bee2f', 'id': 'f96cb636-9caf-4760-908c-b1b0f1b55a85'} Jul 05 20:58:22.155312 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 05 20:58:22.155312 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 20:58:22.155312 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jul 05 20:58:22.155312 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jul 05 20:58:22.155312 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 05 20:58:22.155312 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 05 20:58:22.155312 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 05 20:58:22.155312 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 05 20:58:22.155312 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance c6c3c1ea-31e8-4c65-b73d-669f337bee2f in vm_state rescued. Cannot detach_volume while the instance is in this state. Jul 05 20:58:22.155312 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi Jul 05 20:58:22.155312 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 20:58:22.155312 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi Jul 05 20:58:22.155312 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 20:58:22.155312 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 20:58:22.155312 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 20:58:22.155312 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 05 20:58:22.155312 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 05 20:58:22.155312 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 05 20:58:22.155312 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 05 20:58:22.156914 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Jul 05 20:58:22.156914 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 05 20:58:22.156914 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 05 20:58:22.156914 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 05 20:58:22.156914 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance c6c3c1ea-31e8-4c65-b73d-669f337bee2f while it is in vm_state rescued Jul 05 20:58:22.156914 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi Jul 05 20:58:22.156914 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 20:58:22.156914 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi Jul 05 20:58:22.156914 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 20:58:22.156914 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 20:58:22.156914 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 20:58:22.156914 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 05 20:58:22.156914 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 05 20:58:22.156914 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance c6c3c1ea-31e8-4c65-b73d-669f337bee2f while it is in vm_state rescued Jul 05 20:58:22.156914 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi Jul 05 20:58:22.156914 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-9daeac88-0afa-4022-a74d-b951202e266a tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Returning 409 to user: Cannot 'detach_volume' instance c6c3c1ea-31e8-4c65-b73d-669f337bee2f while it is in vm_state rescued {{(pid=117628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 05 20:58:22.158298 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-9daeac88-0afa-4022-a74d-b951202e266a tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] 10.222.0.20 "DELETE /compute/v2.1/servers/c6c3c1ea-31e8-4c65-b73d-669f337bee2f/os-volume_attachments/f96cb636-9caf-4760-908c-b1b0f1b55a85" status: 409 len: 152 microversion: 2.1 time: 0.142734 Jul 05 20:58:22.158298 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 250/489] 10.222.0.20 () {58 vars in 1415 bytes} [Tue Jul 5 20:58:22 2022] DELETE /compute/v2.1/servers/c6c3c1ea-31e8-4c65-b73d-669f337bee2f/os-volume_attachments/f96cb636-9caf-4760-908c-b1b0f1b55a85 => generated 152 bytes in 144 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Jul 05 20:58:22.162994 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-d2824cf1-8494-4b7f-8f55-9daa020e4926 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 20:58:22.163576 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-d2824cf1-8494-4b7f-8f55-9daa020e4926 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] [instance: c6c3c1ea-31e8-4c65-b73d-669f337bee2f] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:58:22.169850 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-d2824cf1-8494-4b7f-8f55-9daa020e4926 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:58:22.170288 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-d2824cf1-8494-4b7f-8f55-9daa020e4926 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:58:22.171153 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-d2824cf1-8494-4b7f-8f55-9daa020e4926 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:58:22.171587 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-d2824cf1-8494-4b7f-8f55-9daa020e4926 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:58:22.234809 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-d2824cf1-8494-4b7f-8f55-9daa020e4926 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] 10.222.0.20 "POST /compute/v2.1/servers/c6c3c1ea-31e8-4c65-b73d-669f337bee2f/action" status: 202 len: 0 microversion: 2.1 time: 0.075286 Jul 05 20:58:22.235366 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 240/490] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Jul 5 20:58:22 2022] POST /compute/v2.1/servers/c6c3c1ea-31e8-4c65-b73d-669f337bee2f/action => generated 0 bytes in 77 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 05 20:58:22.243325 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-7ec9a8a3-29c9-4131-b60a-9800f469a270 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:58:22.243953 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-7ec9a8a3-29c9-4131-b60a-9800f469a270 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] [instance: c6c3c1ea-31e8-4c65-b73d-669f337bee2f] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:58:22.251344 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-7ec9a8a3-29c9-4131-b60a-9800f469a270 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:58:22.251786 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-7ec9a8a3-29c9-4131-b60a-9800f469a270 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:58:22.252539 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-7ec9a8a3-29c9-4131-b60a-9800f469a270 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:58:22.253000 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-7ec9a8a3-29c9-4131-b60a-9800f469a270 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:58:22.426659 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-7ec9a8a3-29c9-4131-b60a-9800f469a270 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd152763a64794301b21587ab2b395bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc6d47f96d17471d94367bc8f8a3e3f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:58:22.434842 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-7ec9a8a3-29c9-4131-b60a-9800f469a270 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] 10.222.0.20 "GET /compute/v2.1/servers/c6c3c1ea-31e8-4c65-b73d-669f337bee2f" status: 200 len: 1722 microversion: 2.1 time: 0.195265 Jul 05 20:58:22.435396 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 251/491] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:58:22 2022] GET /compute/v2.1/servers/c6c3c1ea-31e8-4c65-b73d-669f337bee2f => generated 1722 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 20:58:22.484762 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-cc9866f5-2974-4736-a2de-cc1de3a3af61 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:58:22.485558 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-cc9866f5-2974-4736-a2de-cc1de3a3af61 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] [instance: f236112c-4649-478b-a626-b84f8ff1bfe9] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:58:22.491712 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-cc9866f5-2974-4736-a2de-cc1de3a3af61 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:58:22.492444 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-cc9866f5-2974-4736-a2de-cc1de3a3af61 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:58:22.493494 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-cc9866f5-2974-4736-a2de-cc1de3a3af61 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:58:22.494147 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-cc9866f5-2974-4736-a2de-cc1de3a3af61 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:58:22.632545 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-cc9866f5-2974-4736-a2de-cc1de3a3af61 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eac41ce3f04450b840cff305ec1a5ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47e1ad014d542f98f6b24c8a504d166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:58:22.641134 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-cc9866f5-2974-4736-a2de-cc1de3a3af61 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] 10.222.0.20 "GET /compute/v2.1/servers/f236112c-4649-478b-a626-b84f8ff1bfe9" status: 200 len: 1662 microversion: 2.1 time: 0.160695 Jul 05 20:58:22.641705 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 241/492] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:58:22 2022] GET /compute/v2.1/servers/f236112c-4649-478b-a626-b84f8ff1bfe9 => generated 1662 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 20:58:23.451761 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-80c77ce2-5fb4-45db-adf4-b5129c7b0398 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:58:23.452361 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-80c77ce2-5fb4-45db-adf4-b5129c7b0398 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] [instance: c6c3c1ea-31e8-4c65-b73d-669f337bee2f] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:58:23.458778 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-80c77ce2-5fb4-45db-adf4-b5129c7b0398 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:58:23.459224 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-80c77ce2-5fb4-45db-adf4-b5129c7b0398 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:58:23.459971 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-80c77ce2-5fb4-45db-adf4-b5129c7b0398 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:58:23.460480 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-80c77ce2-5fb4-45db-adf4-b5129c7b0398 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:58:23.591171 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-80c77ce2-5fb4-45db-adf4-b5129c7b0398 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd152763a64794301b21587ab2b395bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc6d47f96d17471d94367bc8f8a3e3f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:58:23.599015 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-80c77ce2-5fb4-45db-adf4-b5129c7b0398 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] 10.222.0.20 "GET /compute/v2.1/servers/c6c3c1ea-31e8-4c65-b73d-669f337bee2f" status: 200 len: 1722 microversion: 2.1 time: 0.151067 Jul 05 20:58:23.599577 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 252/493] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:58:23 2022] GET /compute/v2.1/servers/c6c3c1ea-31e8-4c65-b73d-669f337bee2f => generated 1722 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 20:58:23.659160 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-5df6dbf3-e211-4a01-bf91-ea0297e16b41 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:58:23.659773 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-5df6dbf3-e211-4a01-bf91-ea0297e16b41 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] [instance: f236112c-4649-478b-a626-b84f8ff1bfe9] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:58:23.666934 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-5df6dbf3-e211-4a01-bf91-ea0297e16b41 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:58:23.667400 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-5df6dbf3-e211-4a01-bf91-ea0297e16b41 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:58:23.668151 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-5df6dbf3-e211-4a01-bf91-ea0297e16b41 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:58:23.668577 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-5df6dbf3-e211-4a01-bf91-ea0297e16b41 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:58:23.795646 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-5df6dbf3-e211-4a01-bf91-ea0297e16b41 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eac41ce3f04450b840cff305ec1a5ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47e1ad014d542f98f6b24c8a504d166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:58:23.803141 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-5df6dbf3-e211-4a01-bf91-ea0297e16b41 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] 10.222.0.20 "GET /compute/v2.1/servers/f236112c-4649-478b-a626-b84f8ff1bfe9" status: 200 len: 1666 microversion: 2.1 time: 0.147908 Jul 05 20:58:23.803704 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 242/494] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:58:23 2022] GET /compute/v2.1/servers/f236112c-4649-478b-a626-b84f8ff1bfe9 => generated 1666 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 20:58:24.616444 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-872327ec-68af-404e-9a05-ae37a7fcec47 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:58:24.617075 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-872327ec-68af-404e-9a05-ae37a7fcec47 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] [instance: c6c3c1ea-31e8-4c65-b73d-669f337bee2f] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:58:24.618922 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG dbcounter [-] [117628] Writing DB stats nova_api:SELECT=50 {{(pid=117628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:58:24.624511 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-872327ec-68af-404e-9a05-ae37a7fcec47 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:58:24.624984 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-872327ec-68af-404e-9a05-ae37a7fcec47 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:58:24.625745 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-872327ec-68af-404e-9a05-ae37a7fcec47 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:58:24.626175 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-872327ec-68af-404e-9a05-ae37a7fcec47 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:58:24.753751 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-872327ec-68af-404e-9a05-ae37a7fcec47 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd152763a64794301b21587ab2b395bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc6d47f96d17471d94367bc8f8a3e3f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:58:24.762088 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-872327ec-68af-404e-9a05-ae37a7fcec47 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] 10.222.0.20 "GET /compute/v2.1/servers/c6c3c1ea-31e8-4c65-b73d-669f337bee2f" status: 200 len: 1722 microversion: 2.1 time: 0.149482 Jul 05 20:58:24.762581 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 253/495] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:58:24 2022] GET /compute/v2.1/servers/c6c3c1ea-31e8-4c65-b73d-669f337bee2f => generated 1722 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 20:58:25.779331 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-4f5c073e-885b-4ea5-a578-45e463719b0f tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:58:25.779934 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-4f5c073e-885b-4ea5-a578-45e463719b0f tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] [instance: c6c3c1ea-31e8-4c65-b73d-669f337bee2f] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:58:25.786439 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-4f5c073e-885b-4ea5-a578-45e463719b0f tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:58:25.786877 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-4f5c073e-885b-4ea5-a578-45e463719b0f tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:58:25.787624 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-4f5c073e-885b-4ea5-a578-45e463719b0f tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:58:25.788052 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-4f5c073e-885b-4ea5-a578-45e463719b0f tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:58:25.918408 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-4f5c073e-885b-4ea5-a578-45e463719b0f tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd152763a64794301b21587ab2b395bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc6d47f96d17471d94367bc8f8a3e3f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:58:25.926801 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-4f5c073e-885b-4ea5-a578-45e463719b0f tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] 10.222.0.20 "GET /compute/v2.1/servers/c6c3c1ea-31e8-4c65-b73d-669f337bee2f" status: 200 len: 1722 microversion: 2.1 time: 0.151422 Jul 05 20:58:25.927358 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 243/496] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:58:25 2022] GET /compute/v2.1/servers/c6c3c1ea-31e8-4c65-b73d-669f337bee2f => generated 1722 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 20:58:26.944348 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-4812061d-3e02-4b2b-b02a-423d96e9af8b tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:58:26.944976 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-4812061d-3e02-4b2b-b02a-423d96e9af8b tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] [instance: c6c3c1ea-31e8-4c65-b73d-669f337bee2f] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:58:26.952731 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-4812061d-3e02-4b2b-b02a-423d96e9af8b tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:58:26.953304 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-4812061d-3e02-4b2b-b02a-423d96e9af8b tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:58:26.954080 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-4812061d-3e02-4b2b-b02a-423d96e9af8b tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:58:26.954516 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-4812061d-3e02-4b2b-b02a-423d96e9af8b tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:58:27.215497 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-4812061d-3e02-4b2b-b02a-423d96e9af8b tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd152763a64794301b21587ab2b395bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc6d47f96d17471d94367bc8f8a3e3f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:58:27.223325 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-4812061d-3e02-4b2b-b02a-423d96e9af8b tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] 10.222.0.20 "GET /compute/v2.1/servers/c6c3c1ea-31e8-4c65-b73d-669f337bee2f" status: 200 len: 1728 microversion: 2.1 time: 0.282879 Jul 05 20:58:27.223887 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 254/497] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:58:26 2022] GET /compute/v2.1/servers/c6c3c1ea-31e8-4c65-b73d-669f337bee2f => generated 1728 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 20:58:27.240320 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-80dfafaa-8714-4d98-be2f-dc28f59a834d tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:58:27.240812 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-80dfafaa-8714-4d98-be2f-dc28f59a834d tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] [instance: c6c3c1ea-31e8-4c65-b73d-669f337bee2f] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:58:27.243233 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG dbcounter [-] [117627] Writing DB stats nova_api:SELECT=50 {{(pid=117627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:58:27.248623 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-80dfafaa-8714-4d98-be2f-dc28f59a834d tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:58:27.249105 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-80dfafaa-8714-4d98-be2f-dc28f59a834d tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:58:27.249870 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-80dfafaa-8714-4d98-be2f-dc28f59a834d tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:58:27.250303 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-80dfafaa-8714-4d98-be2f-dc28f59a834d tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:58:27.327873 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-80dfafaa-8714-4d98-be2f-dc28f59a834d tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] 10.222.0.20 "GET /compute/v2.1/servers/c6c3c1ea-31e8-4c65-b73d-669f337bee2f/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.091347 Jul 05 20:58:27.328468 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 244/498] 10.222.0.20 () {58 vars in 1274 bytes} [Tue Jul 5 20:58:27 2022] GET /compute/v2.1/servers/c6c3c1ea-31e8-4c65-b73d-669f337bee2f/os-interface => generated 284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 05 20:58:28.255399 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [req-07df4958-e6e2-42c9-a22c-f360b3a86896 req-b090f1e5-a2a6-403e-8ea9-67068620a4c0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c6c3c1ea-31e8-4c65-b73d-669f337bee2f", "tag": "895e5d50-4373-406a-8f11-70a9e025443e"}]} {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 20:58:28.269017 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [req-07df4958-e6e2-42c9-a22c-f360b3a86896 req-b090f1e5-a2a6-403e-8ea9-67068620a4c0 service nova] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:58:28.269732 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [req-07df4958-e6e2-42c9-a22c-f360b3a86896 req-b090f1e5-a2a6-403e-8ea9-67068620a4c0 service nova] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:58:28.286951 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.compute.server_external_events [req-07df4958-e6e2-42c9-a22c-f360b3a86896 req-b090f1e5-a2a6-403e-8ea9-67068620a4c0 service nova] Creating event network-changed:895e5d50-4373-406a-8f11-70a9e025443e for instance c6c3c1ea-31e8-4c65-b73d-669f337bee2f on hv-cinder-79760 Jul 05 20:58:28.295615 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [req-07df4958-e6e2-42c9-a22c-f360b3a86896 req-b090f1e5-a2a6-403e-8ea9-67068620a4c0 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043281 Jul 05 20:58:28.296244 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 255/499] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 5 20:58:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 20:58:30.309813 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [req-ac009fc1-779c-43a8-b576-8e4cb73bc562 req-d8ea816b-331a-45d1-a9fa-53eaed49f4c0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c6c3c1ea-31e8-4c65-b73d-669f337bee2f", "tag": "895e5d50-4373-406a-8f11-70a9e025443e"}]} {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 20:58:30.317785 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [req-ac009fc1-779c-43a8-b576-8e4cb73bc562 req-d8ea816b-331a-45d1-a9fa-53eaed49f4c0 service nova] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:58:30.318206 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [req-ac009fc1-779c-43a8-b576-8e4cb73bc562 req-d8ea816b-331a-45d1-a9fa-53eaed49f4c0 service nova] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:58:30.330675 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.compute.server_external_events [req-ac009fc1-779c-43a8-b576-8e4cb73bc562 req-d8ea816b-331a-45d1-a9fa-53eaed49f4c0 service nova] Creating event network-changed:895e5d50-4373-406a-8f11-70a9e025443e for instance c6c3c1ea-31e8-4c65-b73d-669f337bee2f on hv-cinder-79760 Jul 05 20:58:30.335671 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [req-ac009fc1-779c-43a8-b576-8e4cb73bc562 req-d8ea816b-331a-45d1-a9fa-53eaed49f4c0 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029964 Jul 05 20:58:30.336279 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 245/500] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 5 20:58:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 20:58:35.680937 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-ba14b318-b334-4ab6-8faf-76732d85cf6c tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:58:35.681521 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-ba14b318-b334-4ab6-8faf-76732d85cf6c tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] [instance: 52848078-62a1-484f-813c-7b3352cb3851] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:58:35.687808 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-ba14b318-b334-4ab6-8faf-76732d85cf6c tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:58:35.688253 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-ba14b318-b334-4ab6-8faf-76732d85cf6c tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:58:35.689031 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-ba14b318-b334-4ab6-8faf-76732d85cf6c tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:58:35.689465 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-ba14b318-b334-4ab6-8faf-76732d85cf6c tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:58:35.717481 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-ba14b318-b334-4ab6-8faf-76732d85cf6c tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] 10.222.0.20 "GET /compute/v2.1/servers/52848078-62a1-484f-813c-7b3352cb3851/os-volume_attachments/7716675e-43c6-42ab-8302-7157246311a4" status: 200 len: 194 microversion: 2.20 time: 0.041312 Jul 05 20:58:35.718056 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 256/501] 10.222.0.20 () {60 vars in 1453 bytes} [Tue Jul 5 20:58:35 2022] GET /compute/v2.1/servers/52848078-62a1-484f-813c-7b3352cb3851/os-volume_attachments/7716675e-43c6-42ab-8302-7157246311a4 => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 05 20:58:35.783907 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-317fc3fc-27dd-4861-b9ce-44259b0a2086 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:58:35.784486 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-317fc3fc-27dd-4861-b9ce-44259b0a2086 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] [instance: 52848078-62a1-484f-813c-7b3352cb3851] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:58:35.790748 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-317fc3fc-27dd-4861-b9ce-44259b0a2086 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:58:35.791197 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-317fc3fc-27dd-4861-b9ce-44259b0a2086 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:58:35.791951 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-317fc3fc-27dd-4861-b9ce-44259b0a2086 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:58:35.793207 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-317fc3fc-27dd-4861-b9ce-44259b0a2086 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:58:35.870982 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.objects.instance [None req-317fc3fc-27dd-4861-b9ce-44259b0a2086 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lazy-loading 'services' on Instance uuid 52848078-62a1-484f-813c-7b3352cb3851 {{(pid=117627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 05 20:58:35.944366 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-317fc3fc-27dd-4861-b9ce-44259b0a2086 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] 10.222.0.20 "DELETE /compute/v2.1/servers/52848078-62a1-484f-813c-7b3352cb3851/os-volume_attachments/7716675e-43c6-42ab-8302-7157246311a4" status: 202 len: 0 microversion: 2.20 time: 0.165081 Jul 05 20:58:35.944881 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 246/502] 10.222.0.20 () {60 vars in 1456 bytes} [Tue Jul 5 20:58:35 2022] DELETE /compute/v2.1/servers/52848078-62a1-484f-813c-7b3352cb3851/os-volume_attachments/7716675e-43c6-42ab-8302-7157246311a4 => generated 0 bytes in 167 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 05 20:58:35.953398 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-e775c726-80e5-42d5-996b-7a72f9262ad7 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:58:35.954360 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-e775c726-80e5-42d5-996b-7a72f9262ad7 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] [instance: 52848078-62a1-484f-813c-7b3352cb3851] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:58:35.960359 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-e775c726-80e5-42d5-996b-7a72f9262ad7 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:58:35.960864 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-e775c726-80e5-42d5-996b-7a72f9262ad7 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:58:35.961693 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-e775c726-80e5-42d5-996b-7a72f9262ad7 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:58:35.962189 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-e775c726-80e5-42d5-996b-7a72f9262ad7 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:58:35.991741 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-e775c726-80e5-42d5-996b-7a72f9262ad7 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] 10.222.0.20 "GET /compute/v2.1/servers/52848078-62a1-484f-813c-7b3352cb3851/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042410 Jul 05 20:58:35.992299 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 257/503] 10.222.0.20 () {60 vars in 1342 bytes} [Tue Jul 5 20:58:35 2022] GET /compute/v2.1/servers/52848078-62a1-484f-813c-7b3352cb3851/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 05 20:58:37.005058 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-3a250238-9552-426e-86c4-d3bcc7fbbab8 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:58:37.006113 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-3a250238-9552-426e-86c4-d3bcc7fbbab8 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] [instance: 52848078-62a1-484f-813c-7b3352cb3851] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:58:37.014733 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-3a250238-9552-426e-86c4-d3bcc7fbbab8 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:58:37.015174 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-3a250238-9552-426e-86c4-d3bcc7fbbab8 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:58:37.015925 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-3a250238-9552-426e-86c4-d3bcc7fbbab8 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:58:37.016351 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-3a250238-9552-426e-86c4-d3bcc7fbbab8 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:58:37.047372 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-3a250238-9552-426e-86c4-d3bcc7fbbab8 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] 10.222.0.20 "GET /compute/v2.1/servers/52848078-62a1-484f-813c-7b3352cb3851/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.047289 Jul 05 20:58:37.047926 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 247/504] 10.222.0.20 () {60 vars in 1342 bytes} [Tue Jul 5 20:58:36 2022] GET /compute/v2.1/servers/52848078-62a1-484f-813c-7b3352cb3851/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 20:58:37.105283 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-d4b21bc2-eb2b-4579-9445-7f5f89e384bf tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:58:37.105813 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-d4b21bc2-eb2b-4579-9445-7f5f89e384bf tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] [instance: 52848078-62a1-484f-813c-7b3352cb3851] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:58:37.112175 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-d4b21bc2-eb2b-4579-9445-7f5f89e384bf tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:58:37.112610 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-d4b21bc2-eb2b-4579-9445-7f5f89e384bf tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:58:37.113399 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-d4b21bc2-eb2b-4579-9445-7f5f89e384bf tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:58:37.113827 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-d4b21bc2-eb2b-4579-9445-7f5f89e384bf tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:58:37.140110 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-d4b21bc2-eb2b-4579-9445-7f5f89e384bf tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] [instance: 52848078-62a1-484f-813c-7b3352cb3851] Going to try to terminate instance {{(pid=117628) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 05 20:58:37.212658 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-d4b21bc2-eb2b-4579-9445-7f5f89e384bf tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] 10.222.0.20 "DELETE /compute/v2.1/servers/52848078-62a1-484f-813c-7b3352cb3851" status: 204 len: 0 microversion: 2.20 time: 0.111400 Jul 05 20:58:37.213502 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 258/505] 10.222.0.20 () {60 vars in 1279 bytes} [Tue Jul 5 20:58:37 2022] DELETE /compute/v2.1/servers/52848078-62a1-484f-813c-7b3352cb3851 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 05 20:58:37.222614 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-532368fd-8694-43c5-b686-45a6c05dad64 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:58:37.223212 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-532368fd-8694-43c5-b686-45a6c05dad64 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] [instance: 52848078-62a1-484f-813c-7b3352cb3851] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:58:37.229166 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-532368fd-8694-43c5-b686-45a6c05dad64 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:58:37.229608 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-532368fd-8694-43c5-b686-45a6c05dad64 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:58:37.231044 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-532368fd-8694-43c5-b686-45a6c05dad64 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:58:37.231472 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-532368fd-8694-43c5-b686-45a6c05dad64 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:58:37.360062 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-532368fd-8694-43c5-b686-45a6c05dad64 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:58:37.367866 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-532368fd-8694-43c5-b686-45a6c05dad64 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:58:37.369372 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-532368fd-8694-43c5-b686-45a6c05dad64 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:58:37.370555 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-532368fd-8694-43c5-b686-45a6c05dad64 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] 10.222.0.20 "GET /compute/v2.1/servers/52848078-62a1-484f-813c-7b3352cb3851" status: 200 len: 1719 microversion: 2.20 time: 0.152151 Jul 05 20:58:37.371099 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 248/506] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 5 20:58:37 2022] GET /compute/v2.1/servers/52848078-62a1-484f-813c-7b3352cb3851 => generated 1719 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 20:58:38.390213 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-0b122ac9-cd8c-4b56-8514-7687fd1d90f9 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:58:38.390905 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-0b122ac9-cd8c-4b56-8514-7687fd1d90f9 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] [instance: 52848078-62a1-484f-813c-7b3352cb3851] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:58:38.397607 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-0b122ac9-cd8c-4b56-8514-7687fd1d90f9 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:58:38.398050 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-0b122ac9-cd8c-4b56-8514-7687fd1d90f9 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:58:38.398801 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-0b122ac9-cd8c-4b56-8514-7687fd1d90f9 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:58:38.399231 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-0b122ac9-cd8c-4b56-8514-7687fd1d90f9 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:58:38.533999 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-0b122ac9-cd8c-4b56-8514-7687fd1d90f9 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:58:38.541918 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-0b122ac9-cd8c-4b56-8514-7687fd1d90f9 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:58:38.544013 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-0b122ac9-cd8c-4b56-8514-7687fd1d90f9 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:58:38.545179 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-0b122ac9-cd8c-4b56-8514-7687fd1d90f9 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] 10.222.0.20 "GET /compute/v2.1/servers/52848078-62a1-484f-813c-7b3352cb3851" status: 200 len: 1719 microversion: 2.20 time: 0.159602 Jul 05 20:58:38.545736 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 259/507] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 5 20:58:38 2022] GET /compute/v2.1/servers/52848078-62a1-484f-813c-7b3352cb3851 => generated 1719 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 05 20:58:39.563646 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-fcc9797e-0423-45bd-bfa1-8b880652fa5a tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:58:39.564415 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-fcc9797e-0423-45bd-bfa1-8b880652fa5a tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] [instance: 52848078-62a1-484f-813c-7b3352cb3851] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:58:39.571134 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-fcc9797e-0423-45bd-bfa1-8b880652fa5a tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:58:39.571663 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-fcc9797e-0423-45bd-bfa1-8b880652fa5a tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:58:39.572418 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-fcc9797e-0423-45bd-bfa1-8b880652fa5a tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:58:39.572850 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-fcc9797e-0423-45bd-bfa1-8b880652fa5a tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:58:39.784754 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-fcc9797e-0423-45bd-bfa1-8b880652fa5a tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:58:39.793656 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-fcc9797e-0423-45bd-bfa1-8b880652fa5a tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:58:39.795149 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-fcc9797e-0423-45bd-bfa1-8b880652fa5a tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:58:39.796286 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-fcc9797e-0423-45bd-bfa1-8b880652fa5a tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] 10.222.0.20 "GET /compute/v2.1/servers/52848078-62a1-484f-813c-7b3352cb3851" status: 200 len: 1719 microversion: 2.20 time: 0.236581 Jul 05 20:58:39.796836 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 249/508] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 5 20:58:39 2022] GET /compute/v2.1/servers/52848078-62a1-484f-813c-7b3352cb3851 => generated 1719 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 20:58:40.163776 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [req-bff16e82-074c-46f9-b863-65610721bc96 req-ecdd3901-d601-4cce-a807-1cf1b360de3a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "52848078-62a1-484f-813c-7b3352cb3851", "name": "network-vif-deleted", "tag": "1f543410-d13c-44b8-9d38-5417d712191c"}]} {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 20:58:40.175396 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [req-bff16e82-074c-46f9-b863-65610721bc96 req-ecdd3901-d601-4cce-a807-1cf1b360de3a service nova] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:58:40.175822 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [req-bff16e82-074c-46f9-b863-65610721bc96 req-ecdd3901-d601-4cce-a807-1cf1b360de3a service nova] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:58:40.189112 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.compute.server_external_events [req-bff16e82-074c-46f9-b863-65610721bc96 req-ecdd3901-d601-4cce-a807-1cf1b360de3a service nova] Creating event network-vif-deleted:1f543410-d13c-44b8-9d38-5417d712191c for instance 52848078-62a1-484f-813c-7b3352cb3851 on hv-cinder-79760 Jul 05 20:58:40.194674 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [req-bff16e82-074c-46f9-b863-65610721bc96 req-ecdd3901-d601-4cce-a807-1cf1b360de3a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034317 Jul 05 20:58:40.195393 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 260/509] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 5 20:58:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 20:58:40.814996 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-93ff3f4a-0009-43f5-94cf-77427cd47b89 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:58:40.815597 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-93ff3f4a-0009-43f5-94cf-77427cd47b89 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] [instance: 52848078-62a1-484f-813c-7b3352cb3851] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:58:40.822360 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-93ff3f4a-0009-43f5-94cf-77427cd47b89 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:58:40.822801 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-93ff3f4a-0009-43f5-94cf-77427cd47b89 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:58:40.824213 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-93ff3f4a-0009-43f5-94cf-77427cd47b89 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:58:40.824690 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-93ff3f4a-0009-43f5-94cf-77427cd47b89 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:58:40.841676 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.wsgi [None req-93ff3f4a-0009-43f5-94cf-77427cd47b89 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] HTTP exception thrown: Instance 52848078-62a1-484f-813c-7b3352cb3851 could not be found. Jul 05 20:58:40.843353 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-93ff3f4a-0009-43f5-94cf-77427cd47b89 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Request method failure captured: Jul 05 20:58:40.843353 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: request: GET /compute/v2.1/servers/52848078-62a1-484f-813c-7b3352cb3851 HTTP/1.1 Jul 05 20:58:40.843353 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: Accept: application/json Jul 05 20:58:40.843353 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: Accept-Encoding: identity Jul 05 20:58:40.843353 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: Connection: close Jul 05 20:58:40.843353 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: Content-Length: 0 Jul 05 20:58:40.843353 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: Content-Type: application/json Jul 05 20:58:40.843353 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: Host: 10.222.0.20 Jul 05 20:58:40.843353 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: Openstack-System-Scope: None Jul 05 20:58:40.843353 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: User-Agent: python-urllib3/1.26.9 Jul 05 20:58:40.843353 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Auth-Token: gAAAAABixKUR25VIYHsot9Ld9h0oSehn7jV7VQkY3bDP_S3_DD7TL5sllffAs82iRo_Pp9DAqOpRwVdCXf-pQX1WqAobGh_RJfgUIlk6hFuqLOQC26Jq7oia9tDs5qiVjC7bNCK_FbmEhr5Yo88V-Wa2dbpmXliHP6WKbgdZxjOWFB2oY--nsJk Jul 05 20:58:40.843353 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Domain-Id: None Jul 05 20:58:40.843353 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Domain-Name: None Jul 05 20:58:40.843353 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Identity-Status: Confirmed Jul 05 20:58:40.843353 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Is-Admin-Project: True Jul 05 20:58:40.843353 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Openstack-Nova-Api-Version: 2.20 Jul 05 20:58:40.843353 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Project-Domain-Id: default Jul 05 20:58:40.843353 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Project-Domain-Name: Default Jul 05 20:58:40.843353 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Project-Id: 9c5fb5bc86604f38b5f0f3a46525189a Jul 05 20:58:40.843353 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2043655930 Jul 05 20:58:40.843353 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Role: member,reader Jul 05 20:58:40.843353 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Roles: member,reader Jul 05 20:58:40.844792 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9c5fb5bc86604f38b5f0f3a46525189a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/9c5fb5bc86604f38b5f0f3a46525189a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_9c5fb5bc86604f38b5f0f3a46525189a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9c5fb5bc86604f38b5f0f3a46525189a"}]}] Jul 05 20:58:40.844792 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2043655930 Jul 05 20:58:40.844792 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Tenant-Id: 9c5fb5bc86604f38b5f0f3a46525189a Jul 05 20:58:40.844792 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2043655930 Jul 05 20:58:40.844792 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-User: tempest-AttachVolumeShelveTestJSON-2043655930-project Jul 05 20:58:40.844792 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-User-Domain-Id: default Jul 05 20:58:40.844792 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-User-Domain-Name: Default Jul 05 20:58:40.844792 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-User-Id: a3792881ae73408db651dd6eb09b3d25 Jul 05 20:58:40.844792 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2043655930-project Jul 05 20:58:40.844792 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: method: > Jul 05 20:58:40.844792 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: exception: Instance 52848078-62a1-484f-813c-7b3352cb3851 could not be found. Jul 05 20:58:40.844792 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: action_args: {'id': '52848078-62a1-484f-813c-7b3352cb3851'} Jul 05 20:58:40.845651 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 05 20:58:40.845651 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 20:58:40.845651 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 05 20:58:40.845651 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 05 20:58:40.845651 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 05 20:58:40.845651 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 05 20:58:40.845651 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 05 20:58:40.845651 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 05 20:58:40.845651 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 05 20:58:40.845651 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 05 20:58:40.845651 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 52848078-62a1-484f-813c-7b3352cb3851 could not be found. Jul 05 20:58:40.845651 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi Jul 05 20:58:40.845651 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 20:58:40.845651 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi Jul 05 20:58:40.845651 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 20:58:40.845651 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 20:58:40.845651 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 20:58:40.845651 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 05 20:58:40.845651 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 05 20:58:40.845651 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 05 20:58:40.846925 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 05 20:58:40.846925 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 05 20:58:40.846925 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 05 20:58:40.846925 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 05 20:58:40.846925 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 05 20:58:40.846925 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 05 20:58:40.846925 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 05 20:58:40.846925 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 52848078-62a1-484f-813c-7b3352cb3851 could not be found. Jul 05 20:58:40.846925 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi Jul 05 20:58:40.846925 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 20:58:40.846925 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi Jul 05 20:58:40.846925 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 20:58:40.846925 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 20:58:40.846925 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 20:58:40.846925 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 05 20:58:40.846925 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 05 20:58:40.846925 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 52848078-62a1-484f-813c-7b3352cb3851 could not be found. Jul 05 20:58:40.846925 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi Jul 05 20:58:40.848061 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-93ff3f4a-0009-43f5-94cf-77427cd47b89 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Returning 404 to user: Instance 52848078-62a1-484f-813c-7b3352cb3851 could not be found. {{(pid=117627) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 05 20:58:40.848061 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-93ff3f4a-0009-43f5-94cf-77427cd47b89 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] 10.222.0.20 "GET /compute/v2.1/servers/52848078-62a1-484f-813c-7b3352cb3851" status: 404 len: 111 microversion: 2.20 time: 0.034080 Jul 05 20:58:40.848061 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 250/510] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 5 20:58:40 2022] GET /compute/v2.1/servers/52848078-62a1-484f-813c-7b3352cb3851 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 05 20:58:40.855450 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-36cbc534-83ae-4a67-843e-8046afd07a12 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Calling method '.version_select at 0x7f57ce050790>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:58:40.875267 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-36cbc534-83ae-4a67-843e-8046afd07a12 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-659881" status: 204 len: 0 microversion: 2.20 time: 0.024563 Jul 05 20:58:40.876013 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 261/511] 10.222.0.20 () {60 vars in 1249 bytes} [Tue Jul 5 20:58:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-659881 => generated 0 bytes in 26 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 05 20:58:41.551318 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-d2bf7dcb-4fdb-4696-8397-c2918a7fd18c tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Action: 'create', calling method: .version_select at 0x7f57ce0e95e0>, body: {"keypair": {"name": "tempest-keypair-4791681", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC4sT2tEUHCpHYYa1UvLMX7aermYaMQGxhT2b2kZfYuZbUdI8n27VHO1jzg7VDEwfAmQmt3wOG0OO5iBPw+ZvgbyY0NqnCAPpD56NmIi9fcQ2jS0CL7RVx0Ni5KUez5jTw=="}} {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 20:58:41.565015 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.quota [None req-d2bf7dcb-4fdb-4696-8397-c2918a7fd18c tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Getting quotas for project 9c5fb5bc86604f38b5f0f3a46525189a. Resources: {'key_pairs'} {{(pid=117627) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 05 20:58:41.568755 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.quota [None req-d2bf7dcb-4fdb-4696-8397-c2918a7fd18c tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Getting quotas for user a3792881ae73408db651dd6eb09b3d25 and project 9c5fb5bc86604f38b5f0f3a46525189a. Resources: {'key_pairs'} {{(pid=117627) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 05 20:58:41.591761 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-d2bf7dcb-4fdb-4696-8397-c2918a7fd18c tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 201 len: 398 microversion: 2.20 time: 0.044305 Jul 05 20:58:41.592343 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 251/512] 10.222.0.20 () {62 vars in 1199 bytes} [Tue Jul 5 20:58:41 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 46 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 05 20:58:43.157680 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-9f1db828-c41f-44f0-8ee7-dfb971d36c81 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-463747346", "imageRef": "88e08f49-c01d-4849-a89f-b678588e56f4", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e74f1f51-bd28-4e7f-8e84-8ec196c505a4"}], "security_groups": [{"name": "tempest-securitygroup--583837141"}], "key_name": "tempest-keypair-4791681", "user_data": "}} {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 20:58:43.257259 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.network.neutron [None req-9f1db828-c41f-44f0-8ee7-dfb971d36c81 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] validate_networks() for [('e74f1f51-bd28-4e7f-8e84-8ec196c505a4', None, None, None, None, None)] {{(pid=117628) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 05 20:58:43.616171 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.virt.hardware [None req-9f1db828-c41f-44f0-8ee7-dfb971d36c81 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Flavor limits 0:0:0 {{(pid=117628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 05 20:58:43.616592 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.virt.hardware [None req-9f1db828-c41f-44f0-8ee7-dfb971d36c81 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Image limits 0:0:0 {{(pid=117628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 05 20:58:43.617101 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.virt.hardware [None req-9f1db828-c41f-44f0-8ee7-dfb971d36c81 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Flavor pref 0:0:0 {{(pid=117628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 05 20:58:43.617509 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.virt.hardware [None req-9f1db828-c41f-44f0-8ee7-dfb971d36c81 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Image pref 0:0:0 {{(pid=117628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 05 20:58:43.617915 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.virt.hardware [None req-9f1db828-c41f-44f0-8ee7-dfb971d36c81 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 05 20:58:43.626980 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-9f1db828-c41f-44f0-8ee7-dfb971d36c81 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:58:43.627422 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-9f1db828-c41f-44f0-8ee7-dfb971d36c81 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:58:43.628210 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-9f1db828-c41f-44f0-8ee7-dfb971d36c81 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:58:43.628640 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-9f1db828-c41f-44f0-8ee7-dfb971d36c81 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:58:43.645856 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.quota [None req-9f1db828-c41f-44f0-8ee7-dfb971d36c81 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Getting quotas for project 9c5fb5bc86604f38b5f0f3a46525189a. Resources: {'cores', 'ram', 'instances'} {{(pid=117628) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 05 20:58:43.650042 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.quota [None req-9f1db828-c41f-44f0-8ee7-dfb971d36c81 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Getting quotas for user a3792881ae73408db651dd6eb09b3d25 and project 9c5fb5bc86604f38b5f0f3a46525189a. Resources: {'cores', 'ram', 'instances'} {{(pid=117628) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 05 20:58:43.661850 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-9f1db828-c41f-44f0-8ee7-dfb971d36c81 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Going to run 1 instances... {{(pid=117628) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 05 20:58:43.664385 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-9f1db828-c41f-44f0-8ee7-dfb971d36c81 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] [instance: 1b6eabe8-54b0-43cf-94ff-9d4abc8168db] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='88e08f49-c01d-4849-a89f-b678588e56f4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117628) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 05 20:58:43.710968 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-9f1db828-c41f-44f0-8ee7-dfb971d36c81 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.557991 Jul 05 20:58:43.711619 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 262/513] 10.222.0.20 () {62 vars in 1187 bytes} [Tue Jul 5 20:58:43 2022] POST /compute/v2.1/servers => generated 401 bytes in 559 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 05 20:58:43.722092 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-68f8394c-a42a-4940-8488-62f3167b0fb5 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:58:43.722715 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-68f8394c-a42a-4940-8488-62f3167b0fb5 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] [instance: 1b6eabe8-54b0-43cf-94ff-9d4abc8168db] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:58:43.781128 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-68f8394c-a42a-4940-8488-62f3167b0fb5 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:58:43.788870 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-68f8394c-a42a-4940-8488-62f3167b0fb5 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:58:43.790805 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-68f8394c-a42a-4940-8488-62f3167b0fb5 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:58:43.792692 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-68f8394c-a42a-4940-8488-62f3167b0fb5 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] 10.222.0.20 "GET /compute/v2.1/servers/1b6eabe8-54b0-43cf-94ff-9d4abc8168db" status: 200 len: 1278 microversion: 2.20 time: 0.074216 Jul 05 20:58:43.793467 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 252/514] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 5 20:58:43 2022] GET /compute/v2.1/servers/1b6eabe8-54b0-43cf-94ff-9d4abc8168db => generated 1278 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 20:58:44.812321 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-a363deb2-79cb-4f30-9c89-0bac719d2f4b tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:58:44.813120 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-a363deb2-79cb-4f30-9c89-0bac719d2f4b tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] [instance: 1b6eabe8-54b0-43cf-94ff-9d4abc8168db] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:58:44.819620 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-a363deb2-79cb-4f30-9c89-0bac719d2f4b tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:58:44.820206 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-a363deb2-79cb-4f30-9c89-0bac719d2f4b tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:58:44.821102 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-a363deb2-79cb-4f30-9c89-0bac719d2f4b tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:58:44.822027 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-a363deb2-79cb-4f30-9c89-0bac719d2f4b tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:58:44.906471 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-a363deb2-79cb-4f30-9c89-0bac719d2f4b tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:58:44.914614 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-a363deb2-79cb-4f30-9c89-0bac719d2f4b tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:58:44.916214 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-a363deb2-79cb-4f30-9c89-0bac719d2f4b tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:58:44.918377 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-a363deb2-79cb-4f30-9c89-0bac719d2f4b tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] 10.222.0.20 "GET /compute/v2.1/servers/1b6eabe8-54b0-43cf-94ff-9d4abc8168db" status: 200 len: 1348 microversion: 2.20 time: 0.111458 Jul 05 20:58:44.919047 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 263/515] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 5 20:58:44 2022] GET /compute/v2.1/servers/1b6eabe8-54b0-43cf-94ff-9d4abc8168db => generated 1348 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 20:58:45.936292 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-a02abb3f-7e9f-45cb-b0be-f9cd38237d98 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:58:45.937003 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-a02abb3f-7e9f-45cb-b0be-f9cd38237d98 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] [instance: 1b6eabe8-54b0-43cf-94ff-9d4abc8168db] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:58:45.943773 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-a02abb3f-7e9f-45cb-b0be-f9cd38237d98 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:58:45.944307 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-a02abb3f-7e9f-45cb-b0be-f9cd38237d98 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:58:45.945199 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-a02abb3f-7e9f-45cb-b0be-f9cd38237d98 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:58:45.945705 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-a02abb3f-7e9f-45cb-b0be-f9cd38237d98 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:58:46.163069 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-a02abb3f-7e9f-45cb-b0be-f9cd38237d98 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:58:46.165766 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG dbcounter [-] [117627] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=117627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:58:46.173072 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-a02abb3f-7e9f-45cb-b0be-f9cd38237d98 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:58:46.174517 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-a02abb3f-7e9f-45cb-b0be-f9cd38237d98 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:58:46.175629 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-a02abb3f-7e9f-45cb-b0be-f9cd38237d98 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] 10.222.0.20 "GET /compute/v2.1/servers/1b6eabe8-54b0-43cf-94ff-9d4abc8168db" status: 200 len: 1403 microversion: 2.20 time: 0.243907 Jul 05 20:58:46.176194 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 253/516] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 5 20:58:45 2022] GET /compute/v2.1/servers/1b6eabe8-54b0-43cf-94ff-9d4abc8168db => generated 1403 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 20:58:46.288436 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [req-098e58c1-90cb-4d49-8929-47cb200485ab req-91b3ede0-9d36-4d09-bddf-6d2149d41936 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1b6eabe8-54b0-43cf-94ff-9d4abc8168db", "tag": "15ebde2f-b2f2-42b3-a2d3-10634ee149d4"}]} {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 20:58:46.299715 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [req-098e58c1-90cb-4d49-8929-47cb200485ab req-91b3ede0-9d36-4d09-bddf-6d2149d41936 service nova] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:58:46.300672 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [req-098e58c1-90cb-4d49-8929-47cb200485ab req-91b3ede0-9d36-4d09-bddf-6d2149d41936 service nova] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:58:46.322044 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.compute.server_external_events [req-098e58c1-90cb-4d49-8929-47cb200485ab req-91b3ede0-9d36-4d09-bddf-6d2149d41936 service nova] Creating event network-changed:15ebde2f-b2f2-42b3-a2d3-10634ee149d4 for instance 1b6eabe8-54b0-43cf-94ff-9d4abc8168db on hv-cinder-79760 Jul 05 20:58:46.328209 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [req-098e58c1-90cb-4d49-8929-47cb200485ab req-91b3ede0-9d36-4d09-bddf-6d2149d41936 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044756 Jul 05 20:58:46.329213 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 264/517] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 5 20:58:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 20:58:47.195226 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-5b56d75f-46a3-4c28-8774-06d715b9182f tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:58:47.195831 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-5b56d75f-46a3-4c28-8774-06d715b9182f tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] [instance: 1b6eabe8-54b0-43cf-94ff-9d4abc8168db] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:58:47.203601 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-5b56d75f-46a3-4c28-8774-06d715b9182f tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:58:47.204049 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-5b56d75f-46a3-4c28-8774-06d715b9182f tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:58:47.204810 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-5b56d75f-46a3-4c28-8774-06d715b9182f tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:58:47.205275 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-5b56d75f-46a3-4c28-8774-06d715b9182f tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:58:47.336681 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-5b56d75f-46a3-4c28-8774-06d715b9182f tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:58:47.344631 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-5b56d75f-46a3-4c28-8774-06d715b9182f tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:58:47.346207 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-5b56d75f-46a3-4c28-8774-06d715b9182f tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:58:47.347333 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-5b56d75f-46a3-4c28-8774-06d715b9182f tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] 10.222.0.20 "GET /compute/v2.1/servers/1b6eabe8-54b0-43cf-94ff-9d4abc8168db" status: 200 len: 1403 microversion: 2.20 time: 0.156670 Jul 05 20:58:47.347909 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 254/518] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 5 20:58:47 2022] GET /compute/v2.1/servers/1b6eabe8-54b0-43cf-94ff-9d4abc8168db => generated 1403 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 20:58:48.366355 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-8998bf33-84e4-45fc-a114-967ac71a2d8c tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:58:48.366966 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-8998bf33-84e4-45fc-a114-967ac71a2d8c tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] [instance: 1b6eabe8-54b0-43cf-94ff-9d4abc8168db] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:58:48.373867 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-8998bf33-84e4-45fc-a114-967ac71a2d8c tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:58:48.374312 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-8998bf33-84e4-45fc-a114-967ac71a2d8c tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:58:48.375072 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-8998bf33-84e4-45fc-a114-967ac71a2d8c tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:58:48.375510 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-8998bf33-84e4-45fc-a114-967ac71a2d8c tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:58:48.514045 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-8998bf33-84e4-45fc-a114-967ac71a2d8c tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:58:48.522290 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-8998bf33-84e4-45fc-a114-967ac71a2d8c tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:58:48.523764 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-8998bf33-84e4-45fc-a114-967ac71a2d8c tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:58:48.524845 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-8998bf33-84e4-45fc-a114-967ac71a2d8c tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] 10.222.0.20 "GET /compute/v2.1/servers/1b6eabe8-54b0-43cf-94ff-9d4abc8168db" status: 200 len: 1403 microversion: 2.20 time: 0.163331 Jul 05 20:58:48.525430 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 265/519] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 5 20:58:48 2022] GET /compute/v2.1/servers/1b6eabe8-54b0-43cf-94ff-9d4abc8168db => generated 1403 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 20:58:49.544000 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-f78b1d20-638d-43e8-9811-d76440a6feb8 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:58:49.544598 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-f78b1d20-638d-43e8-9811-d76440a6feb8 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] [instance: 1b6eabe8-54b0-43cf-94ff-9d4abc8168db] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:58:49.551137 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-f78b1d20-638d-43e8-9811-d76440a6feb8 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:58:49.551579 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-f78b1d20-638d-43e8-9811-d76440a6feb8 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:58:49.552325 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-f78b1d20-638d-43e8-9811-d76440a6feb8 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:58:49.552753 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-f78b1d20-638d-43e8-9811-d76440a6feb8 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:58:49.679920 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-f78b1d20-638d-43e8-9811-d76440a6feb8 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:58:49.688567 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-f78b1d20-638d-43e8-9811-d76440a6feb8 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:58:49.690100 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-f78b1d20-638d-43e8-9811-d76440a6feb8 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:58:49.691190 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-f78b1d20-638d-43e8-9811-d76440a6feb8 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] 10.222.0.20 "GET /compute/v2.1/servers/1b6eabe8-54b0-43cf-94ff-9d4abc8168db" status: 200 len: 1403 microversion: 2.20 time: 0.151064 Jul 05 20:58:49.691740 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 255/520] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 5 20:58:49 2022] GET /compute/v2.1/servers/1b6eabe8-54b0-43cf-94ff-9d4abc8168db => generated 1403 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 20:58:50.709624 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-6f0eca8a-9dfb-4ec8-a2bd-53bd3f69f9e1 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:58:50.710224 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-6f0eca8a-9dfb-4ec8-a2bd-53bd3f69f9e1 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] [instance: 1b6eabe8-54b0-43cf-94ff-9d4abc8168db] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:58:50.717467 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-6f0eca8a-9dfb-4ec8-a2bd-53bd3f69f9e1 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:58:50.717916 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-6f0eca8a-9dfb-4ec8-a2bd-53bd3f69f9e1 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:58:50.718670 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-6f0eca8a-9dfb-4ec8-a2bd-53bd3f69f9e1 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:58:50.719099 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-6f0eca8a-9dfb-4ec8-a2bd-53bd3f69f9e1 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:58:50.852204 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-6f0eca8a-9dfb-4ec8-a2bd-53bd3f69f9e1 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:58:50.860017 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-6f0eca8a-9dfb-4ec8-a2bd-53bd3f69f9e1 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:58:50.861553 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-6f0eca8a-9dfb-4ec8-a2bd-53bd3f69f9e1 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:58:50.862646 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-6f0eca8a-9dfb-4ec8-a2bd-53bd3f69f9e1 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] 10.222.0.20 "GET /compute/v2.1/servers/1b6eabe8-54b0-43cf-94ff-9d4abc8168db" status: 200 len: 1403 microversion: 2.20 time: 0.156932 Jul 05 20:58:50.863200 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 266/521] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 5 20:58:50 2022] GET /compute/v2.1/servers/1b6eabe8-54b0-43cf-94ff-9d4abc8168db => generated 1403 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 20:58:51.879680 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-4b011364-eccb-4217-ab89-48a013a7115f tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:58:51.880278 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-4b011364-eccb-4217-ab89-48a013a7115f tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] [instance: 1b6eabe8-54b0-43cf-94ff-9d4abc8168db] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:58:51.887361 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-4b011364-eccb-4217-ab89-48a013a7115f tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:58:51.887800 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-4b011364-eccb-4217-ab89-48a013a7115f tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:58:51.888566 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-4b011364-eccb-4217-ab89-48a013a7115f tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:58:51.889028 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-4b011364-eccb-4217-ab89-48a013a7115f tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:58:52.017222 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-4b011364-eccb-4217-ab89-48a013a7115f tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:58:52.025405 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-4b011364-eccb-4217-ab89-48a013a7115f tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:58:52.027028 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-4b011364-eccb-4217-ab89-48a013a7115f tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:58:52.028109 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-4b011364-eccb-4217-ab89-48a013a7115f tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] 10.222.0.20 "GET /compute/v2.1/servers/1b6eabe8-54b0-43cf-94ff-9d4abc8168db" status: 200 len: 1403 microversion: 2.20 time: 0.152283 Jul 05 20:58:52.028659 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 256/522] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 5 20:58:51 2022] GET /compute/v2.1/servers/1b6eabe8-54b0-43cf-94ff-9d4abc8168db => generated 1403 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 20:58:52.453617 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [req-7814bb9e-c088-4589-97b4-513ec0cb8505 req-2dd80822-1cea-4fa9-9ac0-2a55f14f060b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b6eabe8-54b0-43cf-94ff-9d4abc8168db", "name": "network-vif-plugged", "status": "completed", "tag": "15ebde2f-b2f2-42b3-a2d3-10634ee149d4"}]} {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 20:58:52.462571 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [req-7814bb9e-c088-4589-97b4-513ec0cb8505 req-2dd80822-1cea-4fa9-9ac0-2a55f14f060b service nova] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:58:52.462914 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [req-7814bb9e-c088-4589-97b4-513ec0cb8505 req-2dd80822-1cea-4fa9-9ac0-2a55f14f060b service nova] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:58:52.467166 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG dbcounter [-] [117628] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:58:52.475040 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.compute.server_external_events [req-7814bb9e-c088-4589-97b4-513ec0cb8505 req-2dd80822-1cea-4fa9-9ac0-2a55f14f060b service nova] Creating event network-vif-plugged:15ebde2f-b2f2-42b3-a2d3-10634ee149d4 for instance 1b6eabe8-54b0-43cf-94ff-9d4abc8168db on hv-cinder-79760 Jul 05 20:58:52.480518 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [req-7814bb9e-c088-4589-97b4-513ec0cb8505 req-2dd80822-1cea-4fa9-9ac0-2a55f14f060b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030653 Jul 05 20:58:52.481293 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 267/523] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 5 20:58:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 20:58:53.046587 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-01ddbb72-c960-4ea7-b827-ef1c7e666220 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:58:53.047199 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-01ddbb72-c960-4ea7-b827-ef1c7e666220 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] [instance: 1b6eabe8-54b0-43cf-94ff-9d4abc8168db] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:58:53.053845 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-01ddbb72-c960-4ea7-b827-ef1c7e666220 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:58:53.054292 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-01ddbb72-c960-4ea7-b827-ef1c7e666220 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:58:53.055088 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-01ddbb72-c960-4ea7-b827-ef1c7e666220 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:58:53.055925 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-01ddbb72-c960-4ea7-b827-ef1c7e666220 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:58:53.191853 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-01ddbb72-c960-4ea7-b827-ef1c7e666220 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:58:53.200492 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-01ddbb72-c960-4ea7-b827-ef1c7e666220 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:58:53.202019 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-01ddbb72-c960-4ea7-b827-ef1c7e666220 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:58:53.203111 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-01ddbb72-c960-4ea7-b827-ef1c7e666220 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] 10.222.0.20 "GET /compute/v2.1/servers/1b6eabe8-54b0-43cf-94ff-9d4abc8168db" status: 200 len: 1403 microversion: 2.20 time: 0.160472 Jul 05 20:58:53.203677 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 257/524] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 5 20:58:53 2022] GET /compute/v2.1/servers/1b6eabe8-54b0-43cf-94ff-9d4abc8168db => generated 1403 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 20:58:54.218252 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG dbcounter [-] [117628] Writing DB stats nova_cell0:SELECT=2 {{(pid=117628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:58:54.219012 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG dbcounter [-] [117628] Writing DB stats nova_cell0:SELECT=6 {{(pid=117628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:58:54.223728 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-a90b9143-f422-4343-b901-1a96a1af0cbc tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:58:54.224437 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-a90b9143-f422-4343-b901-1a96a1af0cbc tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] [instance: 1b6eabe8-54b0-43cf-94ff-9d4abc8168db] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:58:54.233883 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-a90b9143-f422-4343-b901-1a96a1af0cbc tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:58:54.234323 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-a90b9143-f422-4343-b901-1a96a1af0cbc tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:58:54.235069 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-a90b9143-f422-4343-b901-1a96a1af0cbc tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:58:54.235495 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-a90b9143-f422-4343-b901-1a96a1af0cbc tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:58:54.365969 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-a90b9143-f422-4343-b901-1a96a1af0cbc tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:58:54.374029 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-a90b9143-f422-4343-b901-1a96a1af0cbc tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:58:54.375522 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-a90b9143-f422-4343-b901-1a96a1af0cbc tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:58:54.376616 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-a90b9143-f422-4343-b901-1a96a1af0cbc tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] 10.222.0.20 "GET /compute/v2.1/servers/1b6eabe8-54b0-43cf-94ff-9d4abc8168db" status: 200 len: 1403 microversion: 2.20 time: 0.159925 Jul 05 20:58:54.377557 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 268/525] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 5 20:58:54 2022] GET /compute/v2.1/servers/1b6eabe8-54b0-43cf-94ff-9d4abc8168db => generated 1403 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 20:58:55.394851 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-bee05d48-b8f0-455b-b872-a66ef0e1cc2d tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:58:55.395455 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-bee05d48-b8f0-455b-b872-a66ef0e1cc2d tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] [instance: 1b6eabe8-54b0-43cf-94ff-9d4abc8168db] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:58:55.397567 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG dbcounter [-] [117627] Writing DB stats nova_cell0:SELECT=6 {{(pid=117627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:58:55.404419 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-bee05d48-b8f0-455b-b872-a66ef0e1cc2d tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:58:55.404864 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-bee05d48-b8f0-455b-b872-a66ef0e1cc2d tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:58:55.405652 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-bee05d48-b8f0-455b-b872-a66ef0e1cc2d tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:58:55.406086 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-bee05d48-b8f0-455b-b872-a66ef0e1cc2d tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:58:55.535774 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-bee05d48-b8f0-455b-b872-a66ef0e1cc2d tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:58:55.544151 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-bee05d48-b8f0-455b-b872-a66ef0e1cc2d tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:58:55.546067 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-bee05d48-b8f0-455b-b872-a66ef0e1cc2d tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:58:55.547198 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-bee05d48-b8f0-455b-b872-a66ef0e1cc2d tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] 10.222.0.20 "GET /compute/v2.1/servers/1b6eabe8-54b0-43cf-94ff-9d4abc8168db" status: 200 len: 1595 microversion: 2.20 time: 0.156284 Jul 05 20:58:55.547813 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 258/526] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 5 20:58:55 2022] GET /compute/v2.1/servers/1b6eabe8-54b0-43cf-94ff-9d4abc8168db => generated 1595 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 20:58:55.564737 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-5ed46cec-d42d-48d7-ac40-e703a6fae807 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:58:55.565299 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-5ed46cec-d42d-48d7-ac40-e703a6fae807 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] [instance: 1b6eabe8-54b0-43cf-94ff-9d4abc8168db] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:58:55.567515 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG dbcounter [-] [117628] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=117628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:58:55.572861 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-5ed46cec-d42d-48d7-ac40-e703a6fae807 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:58:55.573335 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-5ed46cec-d42d-48d7-ac40-e703a6fae807 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:58:55.574089 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-5ed46cec-d42d-48d7-ac40-e703a6fae807 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:58:55.574515 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-5ed46cec-d42d-48d7-ac40-e703a6fae807 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:58:55.656259 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-5ed46cec-d42d-48d7-ac40-e703a6fae807 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] 10.222.0.20 "GET /compute/v2.1/servers/1b6eabe8-54b0-43cf-94ff-9d4abc8168db/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.095321 Jul 05 20:58:55.656853 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 269/527] 10.222.0.20 () {60 vars in 1315 bytes} [Tue Jul 5 20:58:55 2022] GET /compute/v2.1/servers/1b6eabe8-54b0-43cf-94ff-9d4abc8168db/os-interface => generated 284 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 05 20:58:56.914946 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [req-46b9d41a-afb4-45e1-9218-1a7c91abbc7e req-e1c6099f-76cd-48cf-98ea-81636cd74db9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1b6eabe8-54b0-43cf-94ff-9d4abc8168db", "tag": "15ebde2f-b2f2-42b3-a2d3-10634ee149d4"}]} {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 20:58:56.924602 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [req-46b9d41a-afb4-45e1-9218-1a7c91abbc7e req-e1c6099f-76cd-48cf-98ea-81636cd74db9 service nova] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:58:56.925164 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [req-46b9d41a-afb4-45e1-9218-1a7c91abbc7e req-e1c6099f-76cd-48cf-98ea-81636cd74db9 service nova] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:58:56.937264 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.compute.server_external_events [req-46b9d41a-afb4-45e1-9218-1a7c91abbc7e req-e1c6099f-76cd-48cf-98ea-81636cd74db9 service nova] Creating event network-changed:15ebde2f-b2f2-42b3-a2d3-10634ee149d4 for instance 1b6eabe8-54b0-43cf-94ff-9d4abc8168db on hv-cinder-79760 Jul 05 20:58:56.942308 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [req-46b9d41a-afb4-45e1-9218-1a7c91abbc7e req-e1c6099f-76cd-48cf-98ea-81636cd74db9 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031003 Jul 05 20:58:56.942885 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 259/528] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 5 20:58:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 20:59:02.191704 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-68272b28-8863-4b4d-a5f1-568e2ea1132f tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:59:02.192646 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-68272b28-8863-4b4d-a5f1-568e2ea1132f tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] [instance: f236112c-4649-478b-a626-b84f8ff1bfe9] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:59:02.198873 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-68272b28-8863-4b4d-a5f1-568e2ea1132f tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:59:02.199318 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-68272b28-8863-4b4d-a5f1-568e2ea1132f tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:59:02.200071 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-68272b28-8863-4b4d-a5f1-568e2ea1132f tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:59:02.200504 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-68272b28-8863-4b4d-a5f1-568e2ea1132f tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:59:02.228199 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-68272b28-8863-4b4d-a5f1-568e2ea1132f tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] 10.222.0.20 "GET /compute/v2.1/servers/f236112c-4649-478b-a626-b84f8ff1bfe9/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.040848 Jul 05 20:59:02.229373 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 270/529] 10.222.0.20 () {58 vars in 1301 bytes} [Tue Jul 5 20:59:02 2022] GET /compute/v2.1/servers/f236112c-4649-478b-a626-b84f8ff1bfe9/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 05 20:59:02.286820 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-56187dac-1c8a-4bb3-bec2-edcd3d10e63a tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:59:02.287385 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-56187dac-1c8a-4bb3-bec2-edcd3d10e63a tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] [instance: f236112c-4649-478b-a626-b84f8ff1bfe9] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:59:02.289313 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG dbcounter [-] [117627] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=1 {{(pid=117627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:59:02.295303 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-56187dac-1c8a-4bb3-bec2-edcd3d10e63a tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:59:02.295748 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-56187dac-1c8a-4bb3-bec2-edcd3d10e63a tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:59:02.296492 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-56187dac-1c8a-4bb3-bec2-edcd3d10e63a tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:59:02.296924 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-56187dac-1c8a-4bb3-bec2-edcd3d10e63a tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:59:02.322732 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-56187dac-1c8a-4bb3-bec2-edcd3d10e63a tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] [instance: f236112c-4649-478b-a626-b84f8ff1bfe9] Going to try to terminate instance {{(pid=117627) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 05 20:59:02.399394 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-56187dac-1c8a-4bb3-bec2-edcd3d10e63a tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] 10.222.0.20 "DELETE /compute/v2.1/servers/f236112c-4649-478b-a626-b84f8ff1bfe9" status: 204 len: 0 microversion: 2.1 time: 0.116765 Jul 05 20:59:02.400193 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 260/530] 10.222.0.20 () {58 vars in 1238 bytes} [Tue Jul 5 20:59:02 2022] DELETE /compute/v2.1/servers/f236112c-4649-478b-a626-b84f8ff1bfe9 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 05 20:59:02.410593 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-59d28b4d-bf05-46f0-b138-c593fc5eb9ad tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:59:02.411289 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-59d28b4d-bf05-46f0-b138-c593fc5eb9ad tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] [instance: f236112c-4649-478b-a626-b84f8ff1bfe9] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:59:02.418360 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-59d28b4d-bf05-46f0-b138-c593fc5eb9ad tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:59:02.418798 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-59d28b4d-bf05-46f0-b138-c593fc5eb9ad tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:59:02.419554 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-59d28b4d-bf05-46f0-b138-c593fc5eb9ad tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:59:02.419981 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-59d28b4d-bf05-46f0-b138-c593fc5eb9ad tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:59:02.557806 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-59d28b4d-bf05-46f0-b138-c593fc5eb9ad tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eac41ce3f04450b840cff305ec1a5ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47e1ad014d542f98f6b24c8a504d166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:59:02.566888 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-59d28b4d-bf05-46f0-b138-c593fc5eb9ad tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] 10.222.0.20 "GET /compute/v2.1/servers/f236112c-4649-478b-a626-b84f8ff1bfe9" status: 200 len: 1672 microversion: 2.1 time: 0.162014 Jul 05 20:59:02.567632 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 271/531] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:59:02 2022] GET /compute/v2.1/servers/f236112c-4649-478b-a626-b84f8ff1bfe9 => generated 1672 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 20:59:03.586461 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-df6c75cb-546c-498c-9cc0-16c96d3c7e4c tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:59:03.587148 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-df6c75cb-546c-498c-9cc0-16c96d3c7e4c tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] [instance: f236112c-4649-478b-a626-b84f8ff1bfe9] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:59:03.593577 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-df6c75cb-546c-498c-9cc0-16c96d3c7e4c tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:59:03.594019 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-df6c75cb-546c-498c-9cc0-16c96d3c7e4c tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:59:03.594765 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-df6c75cb-546c-498c-9cc0-16c96d3c7e4c tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:59:03.595190 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-df6c75cb-546c-498c-9cc0-16c96d3c7e4c tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:59:03.726667 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-df6c75cb-546c-498c-9cc0-16c96d3c7e4c tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eac41ce3f04450b840cff305ec1a5ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47e1ad014d542f98f6b24c8a504d166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:59:03.734735 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-df6c75cb-546c-498c-9cc0-16c96d3c7e4c tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] 10.222.0.20 "GET /compute/v2.1/servers/f236112c-4649-478b-a626-b84f8ff1bfe9" status: 200 len: 1672 microversion: 2.1 time: 0.152463 Jul 05 20:59:03.735303 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 261/532] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:59:03 2022] GET /compute/v2.1/servers/f236112c-4649-478b-a626-b84f8ff1bfe9 => generated 1672 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 20:59:04.751842 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-da4400d1-3f26-417b-b051-03e8f24b14e0 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:59:04.752556 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-da4400d1-3f26-417b-b051-03e8f24b14e0 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] [instance: f236112c-4649-478b-a626-b84f8ff1bfe9] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:59:04.758942 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-da4400d1-3f26-417b-b051-03e8f24b14e0 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:59:04.759414 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-da4400d1-3f26-417b-b051-03e8f24b14e0 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:59:04.764355 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-da4400d1-3f26-417b-b051-03e8f24b14e0 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:59:04.764355 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-da4400d1-3f26-417b-b051-03e8f24b14e0 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:59:04.974400 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-da4400d1-3f26-417b-b051-03e8f24b14e0 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eac41ce3f04450b840cff305ec1a5ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47e1ad014d542f98f6b24c8a504d166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:59:04.982747 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-da4400d1-3f26-417b-b051-03e8f24b14e0 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] 10.222.0.20 "GET /compute/v2.1/servers/f236112c-4649-478b-a626-b84f8ff1bfe9" status: 200 len: 1672 microversion: 2.1 time: 0.235035 Jul 05 20:59:04.983398 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 272/533] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:59:04 2022] GET /compute/v2.1/servers/f236112c-4649-478b-a626-b84f8ff1bfe9 => generated 1672 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 20:59:05.517733 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [req-8d54c004-4379-4ec4-be42-d49a9f14b0a4 req-381d8555-daee-4e2f-9bfa-53f5e09dae97 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f236112c-4649-478b-a626-b84f8ff1bfe9", "name": "network-vif-deleted", "tag": "63ac1cb2-ef2b-47e3-9bb9-22cffd540dec"}]} {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 20:59:05.528085 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [req-8d54c004-4379-4ec4-be42-d49a9f14b0a4 req-381d8555-daee-4e2f-9bfa-53f5e09dae97 service nova] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:59:05.528525 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [req-8d54c004-4379-4ec4-be42-d49a9f14b0a4 req-381d8555-daee-4e2f-9bfa-53f5e09dae97 service nova] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:59:05.541372 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.compute.server_external_events [req-8d54c004-4379-4ec4-be42-d49a9f14b0a4 req-381d8555-daee-4e2f-9bfa-53f5e09dae97 service nova] Creating event network-vif-deleted:63ac1cb2-ef2b-47e3-9bb9-22cffd540dec for instance f236112c-4649-478b-a626-b84f8ff1bfe9 on hv-cinder-79760 Jul 05 20:59:05.547526 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [req-8d54c004-4379-4ec4-be42-d49a9f14b0a4 req-381d8555-daee-4e2f-9bfa-53f5e09dae97 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034085 Jul 05 20:59:05.548116 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 262/534] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 5 20:59:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 20:59:06.001101 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-79ed5d0c-b318-462f-a2a1-1db58c112bbe tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:59:06.001844 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-79ed5d0c-b318-462f-a2a1-1db58c112bbe tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] [instance: f236112c-4649-478b-a626-b84f8ff1bfe9] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:59:06.009393 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-79ed5d0c-b318-462f-a2a1-1db58c112bbe tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:59:06.010120 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-79ed5d0c-b318-462f-a2a1-1db58c112bbe tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:59:06.011131 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-79ed5d0c-b318-462f-a2a1-1db58c112bbe tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:59:06.011877 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-79ed5d0c-b318-462f-a2a1-1db58c112bbe tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:59:06.047315 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-79ed5d0c-b318-462f-a2a1-1db58c112bbe tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:59:06.047766 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-79ed5d0c-b318-462f-a2a1-1db58c112bbe tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:59:06.048212 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.objects.instance [None req-79ed5d0c-b318-462f-a2a1-1db58c112bbe tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lazy-loading 'fault' on Instance uuid f236112c-4649-478b-a626-b84f8ff1bfe9 {{(pid=117628) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 05 20:59:06.097087 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-79ed5d0c-b318-462f-a2a1-1db58c112bbe tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eac41ce3f04450b840cff305ec1a5ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47e1ad014d542f98f6b24c8a504d166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:59:06.106563 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-79ed5d0c-b318-462f-a2a1-1db58c112bbe tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] 10.222.0.20 "GET /compute/v2.1/servers/f236112c-4649-478b-a626-b84f8ff1bfe9" status: 200 len: 1328 microversion: 2.1 time: 0.109275 Jul 05 20:59:06.107681 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 273/535] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:59:05 2022] GET /compute/v2.1/servers/f236112c-4649-478b-a626-b84f8ff1bfe9 => generated 1328 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 20:59:06.281057 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-3423fde8-02bd-4444-8942-807a43d378be tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:59:06.281635 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-3423fde8-02bd-4444-8942-807a43d378be tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] [instance: c6c3c1ea-31e8-4c65-b73d-669f337bee2f] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:59:06.288220 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-3423fde8-02bd-4444-8942-807a43d378be tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:59:06.288700 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-3423fde8-02bd-4444-8942-807a43d378be tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:59:06.289508 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-3423fde8-02bd-4444-8942-807a43d378be tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:59:06.289942 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-3423fde8-02bd-4444-8942-807a43d378be tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:59:06.375228 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.objects.instance [None req-3423fde8-02bd-4444-8942-807a43d378be tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lazy-loading 'services' on Instance uuid c6c3c1ea-31e8-4c65-b73d-669f337bee2f {{(pid=117627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 05 20:59:06.447496 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-3423fde8-02bd-4444-8942-807a43d378be tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] 10.222.0.20 "DELETE /compute/v2.1/servers/c6c3c1ea-31e8-4c65-b73d-669f337bee2f/os-volume_attachments/f96cb636-9caf-4760-908c-b1b0f1b55a85" status: 202 len: 0 microversion: 2.1 time: 0.170174 Jul 05 20:59:06.448322 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 263/536] 10.222.0.20 () {58 vars in 1415 bytes} [Tue Jul 5 20:59:06 2022] DELETE /compute/v2.1/servers/c6c3c1ea-31e8-4c65-b73d-669f337bee2f/os-volume_attachments/f96cb636-9caf-4760-908c-b1b0f1b55a85 => generated 0 bytes in 172 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 05 20:59:06.456384 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-21c1e3b1-3500-435c-a403-760acf41fdd4 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:59:06.457339 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-21c1e3b1-3500-435c-a403-760acf41fdd4 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] [instance: c6c3c1ea-31e8-4c65-b73d-669f337bee2f] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:59:06.465317 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-21c1e3b1-3500-435c-a403-760acf41fdd4 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:59:06.465792 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-21c1e3b1-3500-435c-a403-760acf41fdd4 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:59:06.466751 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-21c1e3b1-3500-435c-a403-760acf41fdd4 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:59:06.467195 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-21c1e3b1-3500-435c-a403-760acf41fdd4 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:59:06.513723 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-21c1e3b1-3500-435c-a403-760acf41fdd4 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] 10.222.0.20 "GET /compute/v2.1/servers/c6c3c1ea-31e8-4c65-b73d-669f337bee2f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061216 Jul 05 20:59:06.514297 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 274/537] 10.222.0.20 () {58 vars in 1301 bytes} [Tue Jul 5 20:59:06 2022] GET /compute/v2.1/servers/c6c3c1ea-31e8-4c65-b73d-669f337bee2f/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 20:59:07.125393 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-1456b912-5a13-475d-a3d3-e1be4b55d549 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:59:07.126071 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-1456b912-5a13-475d-a3d3-e1be4b55d549 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] [instance: f236112c-4649-478b-a626-b84f8ff1bfe9] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:59:07.132859 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-1456b912-5a13-475d-a3d3-e1be4b55d549 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:59:07.133342 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-1456b912-5a13-475d-a3d3-e1be4b55d549 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:59:07.134099 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-1456b912-5a13-475d-a3d3-e1be4b55d549 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:59:07.135117 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-1456b912-5a13-475d-a3d3-e1be4b55d549 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:59:07.148409 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.wsgi [None req-1456b912-5a13-475d-a3d3-e1be4b55d549 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] HTTP exception thrown: Instance f236112c-4649-478b-a626-b84f8ff1bfe9 could not be found. Jul 05 20:59:07.150037 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-1456b912-5a13-475d-a3d3-e1be4b55d549 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Request method failure captured: Jul 05 20:59:07.150037 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: request: GET /compute/v2.1/servers/f236112c-4649-478b-a626-b84f8ff1bfe9 HTTP/1.1 Jul 05 20:59:07.150037 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: Accept: application/json Jul 05 20:59:07.150037 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: Accept-Encoding: identity Jul 05 20:59:07.150037 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: Connection: close Jul 05 20:59:07.150037 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: Content-Length: 0 Jul 05 20:59:07.150037 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: Content-Type: application/json Jul 05 20:59:07.150037 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: Host: 10.222.0.20 Jul 05 20:59:07.150037 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: Openstack-System-Scope: None Jul 05 20:59:07.150037 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: User-Agent: python-urllib3/1.26.9 Jul 05 20:59:07.150037 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Auth-Token: gAAAAABixKUH4B5j0zEKvinNFBojvLuZ2PCmMo7rFpX95lsIdciwUpaZiEjJqc2l7qkZUkg05gnf1DMkOon_2FSnNiTU4Un89EcTxDLACWDM3hYnFg_2VDZ7GVK518HYK24njE8pU7e7WNMFX96QTUmXce3fdv9VwGLE0AsaMMcaWY3KTSQ4MzU Jul 05 20:59:07.150037 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Domain-Id: None Jul 05 20:59:07.150037 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Domain-Name: None Jul 05 20:59:07.150037 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Identity-Status: Confirmed Jul 05 20:59:07.150037 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Is-Admin-Project: True Jul 05 20:59:07.150037 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Project-Domain-Id: default Jul 05 20:59:07.150037 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Project-Domain-Name: Default Jul 05 20:59:07.150037 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Project-Id: c47e1ad014d542f98f6b24c8a504d166 Jul 05 20:59:07.150037 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Project-Name: tempest-AttachVolumeTestJSON-2080646407 Jul 05 20:59:07.150037 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Role: member,reader Jul 05 20:59:07.150037 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Roles: member,reader Jul 05 20:59:07.151760 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c47e1ad014d542f98f6b24c8a504d166"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/c47e1ad014d542f98f6b24c8a504d166"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_c47e1ad014d542f98f6b24c8a504d166"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c47e1ad014d542f98f6b24c8a504d166"}]}] Jul 05 20:59:07.151760 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Tenant: tempest-AttachVolumeTestJSON-2080646407 Jul 05 20:59:07.151760 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Tenant-Id: c47e1ad014d542f98f6b24c8a504d166 Jul 05 20:59:07.151760 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2080646407 Jul 05 20:59:07.151760 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-User: tempest-AttachVolumeTestJSON-2080646407-project Jul 05 20:59:07.151760 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-User-Domain-Id: default Jul 05 20:59:07.151760 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-User-Domain-Name: Default Jul 05 20:59:07.151760 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-User-Id: 5eac41ce3f04450b840cff305ec1a5ac Jul 05 20:59:07.151760 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-User-Name: tempest-AttachVolumeTestJSON-2080646407-project Jul 05 20:59:07.151760 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: method: > Jul 05 20:59:07.151760 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: exception: Instance f236112c-4649-478b-a626-b84f8ff1bfe9 could not be found. Jul 05 20:59:07.151760 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: action_args: {'id': 'f236112c-4649-478b-a626-b84f8ff1bfe9'} Jul 05 20:59:07.152731 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 05 20:59:07.152731 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 20:59:07.152731 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 05 20:59:07.152731 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 05 20:59:07.152731 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 05 20:59:07.152731 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 05 20:59:07.152731 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 05 20:59:07.152731 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 05 20:59:07.152731 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 05 20:59:07.152731 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 05 20:59:07.152731 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f236112c-4649-478b-a626-b84f8ff1bfe9 could not be found. Jul 05 20:59:07.152731 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi Jul 05 20:59:07.152731 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 20:59:07.152731 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi Jul 05 20:59:07.152731 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 20:59:07.152731 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 20:59:07.152731 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 20:59:07.152731 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 05 20:59:07.152731 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 05 20:59:07.152731 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 05 20:59:07.154231 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 05 20:59:07.154231 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 05 20:59:07.154231 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 05 20:59:07.154231 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 05 20:59:07.154231 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 05 20:59:07.154231 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 05 20:59:07.154231 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 05 20:59:07.154231 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f236112c-4649-478b-a626-b84f8ff1bfe9 could not be found. Jul 05 20:59:07.154231 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi Jul 05 20:59:07.154231 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 20:59:07.154231 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi Jul 05 20:59:07.154231 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 20:59:07.154231 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 20:59:07.154231 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 20:59:07.154231 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 05 20:59:07.154231 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 05 20:59:07.154231 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f236112c-4649-478b-a626-b84f8ff1bfe9 could not be found. Jul 05 20:59:07.154231 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi Jul 05 20:59:07.155580 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-1456b912-5a13-475d-a3d3-e1be4b55d549 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Returning 404 to user: Instance f236112c-4649-478b-a626-b84f8ff1bfe9 could not be found. {{(pid=117627) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 05 20:59:07.155580 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-1456b912-5a13-475d-a3d3-e1be4b55d549 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] 10.222.0.20 "GET /compute/v2.1/servers/f236112c-4649-478b-a626-b84f8ff1bfe9" status: 404 len: 111 microversion: 2.1 time: 0.030512 Jul 05 20:59:07.155580 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 264/538] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:59:07 2022] GET /compute/v2.1/servers/f236112c-4649-478b-a626-b84f8ff1bfe9 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 05 20:59:07.160166 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-f6cb37d7-f066-46f4-80ae-741af0703635 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Calling method '.version_select at 0x7f57ce053550>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:59:07.179489 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-f6cb37d7-f066-46f4-80ae-741af0703635 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1081690412" status: 202 len: 0 microversion: 2.1 time: 0.022981 Jul 05 20:59:07.180268 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 275/539] 10.222.0.20 () {58 vars in 1220 bytes} [Tue Jul 5 20:59:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1081690412 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 05 20:59:07.525603 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-69c310f0-8c29-4329-9fef-ae0c66b58fab tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:59:07.526651 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-69c310f0-8c29-4329-9fef-ae0c66b58fab tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] [instance: c6c3c1ea-31e8-4c65-b73d-669f337bee2f] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:59:07.532603 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-69c310f0-8c29-4329-9fef-ae0c66b58fab tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:59:07.533100 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-69c310f0-8c29-4329-9fef-ae0c66b58fab tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:59:07.533865 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-69c310f0-8c29-4329-9fef-ae0c66b58fab tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:59:07.534304 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-69c310f0-8c29-4329-9fef-ae0c66b58fab tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:59:07.564268 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-69c310f0-8c29-4329-9fef-ae0c66b58fab tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] 10.222.0.20 "GET /compute/v2.1/servers/c6c3c1ea-31e8-4c65-b73d-669f337bee2f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042838 Jul 05 20:59:07.564828 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 265/540] 10.222.0.20 () {58 vars in 1301 bytes} [Tue Jul 5 20:59:07 2022] GET /compute/v2.1/servers/c6c3c1ea-31e8-4c65-b73d-669f337bee2f/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 05 20:59:07.640177 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-a803106b-6aa8-4e7b-853b-02362d530bf9 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:59:07.641021 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-a803106b-6aa8-4e7b-853b-02362d530bf9 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] [instance: c6c3c1ea-31e8-4c65-b73d-669f337bee2f] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:59:07.647457 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-a803106b-6aa8-4e7b-853b-02362d530bf9 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:59:07.647956 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-a803106b-6aa8-4e7b-853b-02362d530bf9 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:59:07.648717 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-a803106b-6aa8-4e7b-853b-02362d530bf9 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:59:07.649197 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-a803106b-6aa8-4e7b-853b-02362d530bf9 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:59:07.676734 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-a803106b-6aa8-4e7b-853b-02362d530bf9 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] [instance: c6c3c1ea-31e8-4c65-b73d-669f337bee2f] Going to try to terminate instance {{(pid=117628) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 05 20:59:07.760293 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-a803106b-6aa8-4e7b-853b-02362d530bf9 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] 10.222.0.20 "DELETE /compute/v2.1/servers/c6c3c1ea-31e8-4c65-b73d-669f337bee2f" status: 204 len: 0 microversion: 2.1 time: 0.123675 Jul 05 20:59:07.761565 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 276/541] 10.222.0.20 () {58 vars in 1238 bytes} [Tue Jul 5 20:59:07 2022] DELETE /compute/v2.1/servers/c6c3c1ea-31e8-4c65-b73d-669f337bee2f => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 05 20:59:07.770433 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-aca11eb1-3a29-4903-af03-da6c0a6f574e tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:59:07.771242 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-aca11eb1-3a29-4903-af03-da6c0a6f574e tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] [instance: c6c3c1ea-31e8-4c65-b73d-669f337bee2f] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:59:07.779608 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-aca11eb1-3a29-4903-af03-da6c0a6f574e tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:59:07.780057 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-aca11eb1-3a29-4903-af03-da6c0a6f574e tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:59:07.780828 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-aca11eb1-3a29-4903-af03-da6c0a6f574e tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:59:07.781297 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-aca11eb1-3a29-4903-af03-da6c0a6f574e tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:59:07.836862 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-07c39540-e6f3-46fc-84f0-69dc8fb20bb1 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Action: 'create', calling method: .version_select at 0x7f57ce0ac670>, body: {"keypair": {"name": "tempest-keypair-676421919", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCCgw4RoV1PJiQn/lWte8iDnAruB+oXgKrTn+rd56qu6sXvelG3tycyDOxWLGrKEjcqc8GwJy4NCktDFmSz4jpWGjlLcmfgn8HSqNLihL0laEfm6K9Ggcpy8G2S2+1vp4w=="}} {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 20:59:07.851125 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.quota [None req-07c39540-e6f3-46fc-84f0-69dc8fb20bb1 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Getting quotas for project c47e1ad014d542f98f6b24c8a504d166. Resources: {'key_pairs'} {{(pid=117628) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 05 20:59:07.855521 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.quota [None req-07c39540-e6f3-46fc-84f0-69dc8fb20bb1 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Getting quotas for user 5eac41ce3f04450b840cff305ec1a5ac and project c47e1ad014d542f98f6b24c8a504d166. Resources: {'key_pairs'} {{(pid=117628) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 05 20:59:07.878268 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-07c39540-e6f3-46fc-84f0-69dc8fb20bb1 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.045549 Jul 05 20:59:07.878867 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 277/542] 10.222.0.20 () {60 vars in 1158 bytes} [Tue Jul 5 20:59:07 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 05 20:59:07.921237 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-aca11eb1-3a29-4903-af03-da6c0a6f574e tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd152763a64794301b21587ab2b395bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc6d47f96d17471d94367bc8f8a3e3f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:59:07.929223 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-aca11eb1-3a29-4903-af03-da6c0a6f574e tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] 10.222.0.20 "GET /compute/v2.1/servers/c6c3c1ea-31e8-4c65-b73d-669f337bee2f" status: 200 len: 1688 microversion: 2.1 time: 0.163677 Jul 05 20:59:07.938242 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 266/543] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:59:07 2022] GET /compute/v2.1/servers/c6c3c1ea-31e8-4c65-b73d-669f337bee2f => generated 1688 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 20:59:08.946965 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-24dc0a09-a678-46d6-af68-73ecc317ce5b tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:59:08.947736 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-24dc0a09-a678-46d6-af68-73ecc317ce5b tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] [instance: c6c3c1ea-31e8-4c65-b73d-669f337bee2f] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:59:08.954566 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-24dc0a09-a678-46d6-af68-73ecc317ce5b tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:59:08.955094 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-24dc0a09-a678-46d6-af68-73ecc317ce5b tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:59:08.955957 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-24dc0a09-a678-46d6-af68-73ecc317ce5b tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:59:08.956491 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-24dc0a09-a678-46d6-af68-73ecc317ce5b tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:59:09.150994 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-24dc0a09-a678-46d6-af68-73ecc317ce5b tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd152763a64794301b21587ab2b395bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc6d47f96d17471d94367bc8f8a3e3f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:59:09.158575 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-24dc0a09-a678-46d6-af68-73ecc317ce5b tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] 10.222.0.20 "GET /compute/v2.1/servers/c6c3c1ea-31e8-4c65-b73d-669f337bee2f" status: 200 len: 1688 microversion: 2.1 time: 0.216031 Jul 05 20:59:09.159088 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 278/544] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:59:08 2022] GET /compute/v2.1/servers/c6c3c1ea-31e8-4c65-b73d-669f337bee2f => generated 1688 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 20:59:09.222407 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-30f3738d-a904-4669-b25e-0475ebfbea34 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1077559690", "imageRef": "88e08f49-c01d-4849-a89f-b678588e56f4", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e8141f6d-89df-4417-ae89-c8d06b44cee8"}], "security_groups": [{"name": "tempest-securitygroup--752536937"}], "key_name": "tempest-keypair-676421919", "user_data": "}} {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 20:59:09.321595 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.network.neutron [None req-30f3738d-a904-4669-b25e-0475ebfbea34 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] validate_networks() for [('e8141f6d-89df-4417-ae89-c8d06b44cee8', None, None, None, None, None)] {{(pid=117627) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 05 20:59:09.685697 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.virt.hardware [None req-30f3738d-a904-4669-b25e-0475ebfbea34 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Flavor limits 0:0:0 {{(pid=117627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 05 20:59:09.686116 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.virt.hardware [None req-30f3738d-a904-4669-b25e-0475ebfbea34 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Image limits 0:0:0 {{(pid=117627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 05 20:59:09.686617 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.virt.hardware [None req-30f3738d-a904-4669-b25e-0475ebfbea34 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Flavor pref 0:0:0 {{(pid=117627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 05 20:59:09.687049 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.virt.hardware [None req-30f3738d-a904-4669-b25e-0475ebfbea34 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Image pref 0:0:0 {{(pid=117627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 05 20:59:09.687457 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.virt.hardware [None req-30f3738d-a904-4669-b25e-0475ebfbea34 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 05 20:59:09.696339 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-30f3738d-a904-4669-b25e-0475ebfbea34 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:59:09.697654 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-30f3738d-a904-4669-b25e-0475ebfbea34 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:59:09.698674 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-30f3738d-a904-4669-b25e-0475ebfbea34 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:59:09.699113 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-30f3738d-a904-4669-b25e-0475ebfbea34 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:59:09.716468 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.quota [None req-30f3738d-a904-4669-b25e-0475ebfbea34 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Getting quotas for project c47e1ad014d542f98f6b24c8a504d166. Resources: {'cores', 'ram', 'instances'} {{(pid=117627) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 05 20:59:09.720481 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.quota [None req-30f3738d-a904-4669-b25e-0475ebfbea34 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Getting quotas for user 5eac41ce3f04450b840cff305ec1a5ac and project c47e1ad014d542f98f6b24c8a504d166. Resources: {'cores', 'ram', 'instances'} {{(pid=117627) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 05 20:59:09.732327 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-30f3738d-a904-4669-b25e-0475ebfbea34 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Going to run 1 instances... {{(pid=117627) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 05 20:59:09.734589 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-30f3738d-a904-4669-b25e-0475ebfbea34 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] [instance: 6064b8b7-d821-4db1-86fa-c24015af68c7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='88e08f49-c01d-4849-a89f-b678588e56f4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117627) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 05 20:59:09.782605 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-30f3738d-a904-4669-b25e-0475ebfbea34 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.564461 Jul 05 20:59:09.783238 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 267/545] 10.222.0.20 () {60 vars in 1146 bytes} [Tue Jul 5 20:59:09 2022] POST /compute/v2.1/servers => generated 401 bytes in 566 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 05 20:59:09.794121 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-d89501b8-7a61-41e6-be69-8d3029a216fe tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:59:09.794848 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-d89501b8-7a61-41e6-be69-8d3029a216fe tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] [instance: 6064b8b7-d821-4db1-86fa-c24015af68c7] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:59:09.849366 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-d89501b8-7a61-41e6-be69-8d3029a216fe tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eac41ce3f04450b840cff305ec1a5ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47e1ad014d542f98f6b24c8a504d166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:59:09.857010 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-d89501b8-7a61-41e6-be69-8d3029a216fe tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] 10.222.0.20 "GET /compute/v2.1/servers/6064b8b7-d821-4db1-86fa-c24015af68c7" status: 200 len: 1237 microversion: 2.1 time: 0.067770 Jul 05 20:59:09.857577 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 279/546] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:59:09 2022] GET /compute/v2.1/servers/6064b8b7-d821-4db1-86fa-c24015af68c7 => generated 1237 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 20:59:10.176061 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-de24409c-6b83-4210-a30f-36eb9b13b864 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:59:10.176703 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-de24409c-6b83-4210-a30f-36eb9b13b864 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] [instance: c6c3c1ea-31e8-4c65-b73d-669f337bee2f] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:59:10.182929 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-de24409c-6b83-4210-a30f-36eb9b13b864 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:59:10.183374 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-de24409c-6b83-4210-a30f-36eb9b13b864 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:59:10.184125 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-de24409c-6b83-4210-a30f-36eb9b13b864 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:59:10.184557 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-de24409c-6b83-4210-a30f-36eb9b13b864 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:59:10.311441 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-de24409c-6b83-4210-a30f-36eb9b13b864 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd152763a64794301b21587ab2b395bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc6d47f96d17471d94367bc8f8a3e3f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:59:10.318783 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-de24409c-6b83-4210-a30f-36eb9b13b864 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] 10.222.0.20 "GET /compute/v2.1/servers/c6c3c1ea-31e8-4c65-b73d-669f337bee2f" status: 200 len: 1688 microversion: 2.1 time: 0.146593 Jul 05 20:59:10.319336 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 268/547] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:59:10 2022] GET /compute/v2.1/servers/c6c3c1ea-31e8-4c65-b73d-669f337bee2f => generated 1688 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 20:59:10.875097 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-722173d3-29fe-45d4-ac0c-e9f953f7bf33 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:59:10.875718 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-722173d3-29fe-45d4-ac0c-e9f953f7bf33 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] [instance: 6064b8b7-d821-4db1-86fa-c24015af68c7] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:59:10.883062 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-722173d3-29fe-45d4-ac0c-e9f953f7bf33 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:59:10.883516 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-722173d3-29fe-45d4-ac0c-e9f953f7bf33 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:59:10.884506 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-722173d3-29fe-45d4-ac0c-e9f953f7bf33 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:59:10.885118 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-722173d3-29fe-45d4-ac0c-e9f953f7bf33 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:59:10.949747 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-722173d3-29fe-45d4-ac0c-e9f953f7bf33 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eac41ce3f04450b840cff305ec1a5ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47e1ad014d542f98f6b24c8a504d166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:59:10.957323 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-722173d3-29fe-45d4-ac0c-e9f953f7bf33 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] 10.222.0.20 "GET /compute/v2.1/servers/6064b8b7-d821-4db1-86fa-c24015af68c7" status: 200 len: 1233 microversion: 2.1 time: 0.086879 Jul 05 20:59:10.957889 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 280/548] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:59:10 2022] GET /compute/v2.1/servers/6064b8b7-d821-4db1-86fa-c24015af68c7 => generated 1233 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 20:59:11.335273 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-212f5bfe-ae71-4dd7-b753-402f1e0dc042 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:59:11.335909 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-212f5bfe-ae71-4dd7-b753-402f1e0dc042 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] [instance: c6c3c1ea-31e8-4c65-b73d-669f337bee2f] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:59:11.342676 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-212f5bfe-ae71-4dd7-b753-402f1e0dc042 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:59:11.343119 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-212f5bfe-ae71-4dd7-b753-402f1e0dc042 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:59:11.343871 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-212f5bfe-ae71-4dd7-b753-402f1e0dc042 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:59:11.344306 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-212f5bfe-ae71-4dd7-b753-402f1e0dc042 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:59:11.498705 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-212f5bfe-ae71-4dd7-b753-402f1e0dc042 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd152763a64794301b21587ab2b395bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc6d47f96d17471d94367bc8f8a3e3f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:59:11.506183 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-212f5bfe-ae71-4dd7-b753-402f1e0dc042 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] 10.222.0.20 "GET /compute/v2.1/servers/c6c3c1ea-31e8-4c65-b73d-669f337bee2f" status: 200 len: 1688 microversion: 2.1 time: 0.174700 Jul 05 20:59:11.506935 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 269/549] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:59:11 2022] GET /compute/v2.1/servers/c6c3c1ea-31e8-4c65-b73d-669f337bee2f => generated 1688 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 20:59:11.742880 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-74f72d62-2742-4226-bbfb-9873cdb65250 tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 20:59:11.744111 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-74f72d62-2742-4226-bbfb-9873cdb65250 tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] [instance: 7b18289e-137f-467c-96ec-cc6179f93e17] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:59:11.752513 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-74f72d62-2742-4226-bbfb-9873cdb65250 tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:59:11.753182 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-74f72d62-2742-4226-bbfb-9873cdb65250 tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:59:11.754189 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-74f72d62-2742-4226-bbfb-9873cdb65250 tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:59:11.754775 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-74f72d62-2742-4226-bbfb-9873cdb65250 tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:59:11.796556 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.objects.instance [None req-74f72d62-2742-4226-bbfb-9873cdb65250 tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Lazy-loading 'flavor' on Instance uuid 7b18289e-137f-467c-96ec-cc6179f93e17 {{(pid=117628) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 05 20:59:11.872061 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-74f72d62-2742-4226-bbfb-9873cdb65250 tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] 10.222.0.20 "POST /compute/v2.1/servers/7b18289e-137f-467c-96ec-cc6179f93e17/action" status: 202 len: 0 microversion: 2.1 time: 0.133518 Jul 05 20:59:11.873055 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 281/550] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Jul 5 20:59:11 2022] POST /compute/v2.1/servers/7b18289e-137f-467c-96ec-cc6179f93e17/action => generated 0 bytes in 135 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 05 20:59:11.882865 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-9ed7baaf-8aac-4b6b-9f64-32e879966554 tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:59:11.884082 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-9ed7baaf-8aac-4b6b-9f64-32e879966554 tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] [instance: 7b18289e-137f-467c-96ec-cc6179f93e17] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:59:11.896870 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-9ed7baaf-8aac-4b6b-9f64-32e879966554 tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:59:11.897828 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-9ed7baaf-8aac-4b6b-9f64-32e879966554 tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:59:11.898681 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-9ed7baaf-8aac-4b6b-9f64-32e879966554 tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:59:11.899228 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-9ed7baaf-8aac-4b6b-9f64-32e879966554 tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:59:11.976237 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-b00ff845-7bf3-42db-82eb-bb20bc4dbc9d tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:59:11.977021 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-b00ff845-7bf3-42db-82eb-bb20bc4dbc9d tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] [instance: 6064b8b7-d821-4db1-86fa-c24015af68c7] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:59:11.984075 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-b00ff845-7bf3-42db-82eb-bb20bc4dbc9d tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:59:11.984613 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-b00ff845-7bf3-42db-82eb-bb20bc4dbc9d tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:59:11.985389 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-b00ff845-7bf3-42db-82eb-bb20bc4dbc9d tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:59:11.986195 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-b00ff845-7bf3-42db-82eb-bb20bc4dbc9d tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:59:12.113115 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-b00ff845-7bf3-42db-82eb-bb20bc4dbc9d tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eac41ce3f04450b840cff305ec1a5ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47e1ad014d542f98f6b24c8a504d166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:59:12.132016 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-b00ff845-7bf3-42db-82eb-bb20bc4dbc9d tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] 10.222.0.20 "GET /compute/v2.1/servers/6064b8b7-d821-4db1-86fa-c24015af68c7" status: 200 len: 1295 microversion: 2.1 time: 0.160699 Jul 05 20:59:12.144474 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 282/551] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:59:11 2022] GET /compute/v2.1/servers/6064b8b7-d821-4db1-86fa-c24015af68c7 => generated 1295 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 20:59:12.152384 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-9ed7baaf-8aac-4b6b-9f64-32e879966554 tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a4b471d14044069a5969e8bc6ca4f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3429e99ac2a94266b152e053bc6a0006', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:59:12.158235 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG dbcounter [-] [117627] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=117627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:59:12.161113 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-9ed7baaf-8aac-4b6b-9f64-32e879966554 tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] 10.222.0.20 "GET /compute/v2.1/servers/7b18289e-137f-467c-96ec-cc6179f93e17" status: 200 len: 1567 microversion: 2.1 time: 0.283641 Jul 05 20:59:12.161688 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 270/552] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:59:11 2022] GET /compute/v2.1/servers/7b18289e-137f-467c-96ec-cc6179f93e17 => generated 1567 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 20:59:12.524728 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-25ab49ec-5b8d-436b-9e83-802a7103abbf tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:59:12.526651 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-25ab49ec-5b8d-436b-9e83-802a7103abbf tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] [instance: c6c3c1ea-31e8-4c65-b73d-669f337bee2f] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:59:12.545739 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-25ab49ec-5b8d-436b-9e83-802a7103abbf tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:59:12.546380 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-25ab49ec-5b8d-436b-9e83-802a7103abbf tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:59:12.547795 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-25ab49ec-5b8d-436b-9e83-802a7103abbf tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:59:12.549505 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-25ab49ec-5b8d-436b-9e83-802a7103abbf tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:59:12.691886 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-25ab49ec-5b8d-436b-9e83-802a7103abbf tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd152763a64794301b21587ab2b395bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc6d47f96d17471d94367bc8f8a3e3f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:59:12.698840 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG dbcounter [-] [117628] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:59:12.711590 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-25ab49ec-5b8d-436b-9e83-802a7103abbf tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] 10.222.0.20 "GET /compute/v2.1/servers/c6c3c1ea-31e8-4c65-b73d-669f337bee2f" status: 200 len: 1620 microversion: 2.1 time: 0.191447 Jul 05 20:59:12.713513 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 283/553] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:59:12 2022] GET /compute/v2.1/servers/c6c3c1ea-31e8-4c65-b73d-669f337bee2f => generated 1620 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 20:59:12.733366 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [req-b9cf305d-ea15-4037-864c-d8c3d20693ed req-a5d3aa1c-85bd-446a-82a7-69abbcd98157 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c6c3c1ea-31e8-4c65-b73d-669f337bee2f", "name": "network-vif-deleted", "tag": "895e5d50-4373-406a-8f11-70a9e025443e"}]} {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 20:59:12.743320 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [req-b9cf305d-ea15-4037-864c-d8c3d20693ed req-a5d3aa1c-85bd-446a-82a7-69abbcd98157 service nova] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:59:12.744009 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [req-b9cf305d-ea15-4037-864c-d8c3d20693ed req-a5d3aa1c-85bd-446a-82a7-69abbcd98157 service nova] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:59:12.756792 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.compute.server_external_events [req-b9cf305d-ea15-4037-864c-d8c3d20693ed req-a5d3aa1c-85bd-446a-82a7-69abbcd98157 service nova] Creating event network-vif-deleted:895e5d50-4373-406a-8f11-70a9e025443e for instance c6c3c1ea-31e8-4c65-b73d-669f337bee2f on hv-cinder-79760 Jul 05 20:59:12.770476 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [req-b9cf305d-ea15-4037-864c-d8c3d20693ed req-a5d3aa1c-85bd-446a-82a7-69abbcd98157 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040957 Jul 05 20:59:12.772023 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 271/554] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 5 20:59:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 20:59:13.152440 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-7bbbe319-2b26-445e-a1c8-def7d72b1ecb tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:59:13.154108 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-7bbbe319-2b26-445e-a1c8-def7d72b1ecb tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] [instance: 6064b8b7-d821-4db1-86fa-c24015af68c7] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:59:13.163145 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-7bbbe319-2b26-445e-a1c8-def7d72b1ecb tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:59:13.164219 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-7bbbe319-2b26-445e-a1c8-def7d72b1ecb tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:59:13.165571 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-7bbbe319-2b26-445e-a1c8-def7d72b1ecb tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:59:13.166941 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-7bbbe319-2b26-445e-a1c8-def7d72b1ecb tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:59:13.179893 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-ce3062ae-5118-4e59-b921-198f9b84adec tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:59:13.182496 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-ce3062ae-5118-4e59-b921-198f9b84adec tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] [instance: 7b18289e-137f-467c-96ec-cc6179f93e17] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:59:13.198585 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-ce3062ae-5118-4e59-b921-198f9b84adec tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:59:13.199175 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-ce3062ae-5118-4e59-b921-198f9b84adec tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:59:13.200047 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-ce3062ae-5118-4e59-b921-198f9b84adec tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:59:13.202163 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-ce3062ae-5118-4e59-b921-198f9b84adec tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:59:13.458708 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-ce3062ae-5118-4e59-b921-198f9b84adec tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a4b471d14044069a5969e8bc6ca4f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3429e99ac2a94266b152e053bc6a0006', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:59:13.468884 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-ce3062ae-5118-4e59-b921-198f9b84adec tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] 10.222.0.20 "GET /compute/v2.1/servers/7b18289e-137f-467c-96ec-cc6179f93e17" status: 200 len: 1567 microversion: 2.1 time: 0.293695 Jul 05 20:59:13.474871 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 272/555] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:59:13 2022] GET /compute/v2.1/servers/7b18289e-137f-467c-96ec-cc6179f93e17 => generated 1567 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 20:59:13.486072 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [req-dc77f956-d041-430d-81ba-d61b17415619 req-00e6ea00-7314-4370-8731-dc37eae8ea69 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6064b8b7-d821-4db1-86fa-c24015af68c7", "tag": "e4577f63-e157-4dcd-b061-03b9dd87e83a"}]} {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 20:59:13.519535 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [req-dc77f956-d041-430d-81ba-d61b17415619 req-00e6ea00-7314-4370-8731-dc37eae8ea69 service nova] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:59:13.520007 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [req-dc77f956-d041-430d-81ba-d61b17415619 req-00e6ea00-7314-4370-8731-dc37eae8ea69 service nova] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:59:13.543432 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.compute.server_external_events [req-dc77f956-d041-430d-81ba-d61b17415619 req-00e6ea00-7314-4370-8731-dc37eae8ea69 service nova] Creating event network-changed:e4577f63-e157-4dcd-b061-03b9dd87e83a for instance 6064b8b7-d821-4db1-86fa-c24015af68c7 on hv-cinder-79760 Jul 05 20:59:13.550697 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [req-dc77f956-d041-430d-81ba-d61b17415619 req-00e6ea00-7314-4370-8731-dc37eae8ea69 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073600 Jul 05 20:59:13.551891 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 273/556] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 5 20:59:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 20:59:13.566346 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-7bbbe319-2b26-445e-a1c8-def7d72b1ecb tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eac41ce3f04450b840cff305ec1a5ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47e1ad014d542f98f6b24c8a504d166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:59:13.576337 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-7bbbe319-2b26-445e-a1c8-def7d72b1ecb tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] 10.222.0.20 "GET /compute/v2.1/servers/6064b8b7-d821-4db1-86fa-c24015af68c7" status: 200 len: 1362 microversion: 2.1 time: 0.428207 Jul 05 20:59:13.577260 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 284/557] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:59:13 2022] GET /compute/v2.1/servers/6064b8b7-d821-4db1-86fa-c24015af68c7 => generated 1362 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 20:59:13.731580 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-da00da6c-3f5e-402e-80b8-de36b3e4006a tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:59:13.732293 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-da00da6c-3f5e-402e-80b8-de36b3e4006a tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] [instance: c6c3c1ea-31e8-4c65-b73d-669f337bee2f] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:59:13.739368 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-da00da6c-3f5e-402e-80b8-de36b3e4006a tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:59:13.741209 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-da00da6c-3f5e-402e-80b8-de36b3e4006a tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:59:13.741977 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-da00da6c-3f5e-402e-80b8-de36b3e4006a tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:59:13.742401 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-da00da6c-3f5e-402e-80b8-de36b3e4006a tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:59:13.757388 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.wsgi [None req-da00da6c-3f5e-402e-80b8-de36b3e4006a tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] HTTP exception thrown: Instance c6c3c1ea-31e8-4c65-b73d-669f337bee2f could not be found. Jul 05 20:59:13.759355 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-da00da6c-3f5e-402e-80b8-de36b3e4006a tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Request method failure captured: Jul 05 20:59:13.759355 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: request: GET /compute/v2.1/servers/c6c3c1ea-31e8-4c65-b73d-669f337bee2f HTTP/1.1 Jul 05 20:59:13.759355 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: Accept: application/json Jul 05 20:59:13.759355 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: Accept-Encoding: identity Jul 05 20:59:13.759355 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: Connection: close Jul 05 20:59:13.759355 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: Content-Length: 0 Jul 05 20:59:13.759355 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: Content-Type: application/json Jul 05 20:59:13.759355 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: Host: 10.222.0.20 Jul 05 20:59:13.759355 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: Openstack-System-Scope: None Jul 05 20:59:13.759355 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: User-Agent: python-urllib3/1.26.9 Jul 05 20:59:13.759355 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Auth-Token: gAAAAABixKUPNuH34QdH2KDVfn6Xq2ExRJFV_gfDikdto6Gtv-4vxOCZQ-cLxCvkxKeLcktJgVnSU2DRVovOt1N1tNauQsWgnI_IcnWeNaI2cc_3sRiAXqXL8oS987NWbN-5be6gxd3B2gK8PLp16_Qnn5ivzsTuuUNEU8MMiW1aGUc2_5VIMUQ Jul 05 20:59:13.759355 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Domain-Id: None Jul 05 20:59:13.759355 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Domain-Name: None Jul 05 20:59:13.759355 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Identity-Status: Confirmed Jul 05 20:59:13.759355 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Is-Admin-Project: True Jul 05 20:59:13.759355 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Project-Domain-Id: default Jul 05 20:59:13.759355 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Project-Domain-Name: Default Jul 05 20:59:13.759355 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Project-Id: fc6d47f96d17471d94367bc8f8a3e3f6 Jul 05 20:59:13.759355 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1951132500 Jul 05 20:59:13.759355 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Role: member,reader Jul 05 20:59:13.759355 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Roles: member,reader Jul 05 20:59:13.761178 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/fc6d47f96d17471d94367bc8f8a3e3f6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/fc6d47f96d17471d94367bc8f8a3e3f6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_fc6d47f96d17471d94367bc8f8a3e3f6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/fc6d47f96d17471d94367bc8f8a3e3f6"}]}] Jul 05 20:59:13.761178 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1951132500 Jul 05 20:59:13.761178 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Tenant-Id: fc6d47f96d17471d94367bc8f8a3e3f6 Jul 05 20:59:13.761178 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1951132500 Jul 05 20:59:13.761178 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-User: tempest-ServerRescueNegativeTestJSON-1951132500-project Jul 05 20:59:13.761178 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-User-Domain-Id: default Jul 05 20:59:13.761178 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-User-Domain-Name: Default Jul 05 20:59:13.761178 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-User-Id: d152763a64794301b21587ab2b395bbf Jul 05 20:59:13.761178 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1951132500-project Jul 05 20:59:13.761178 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: method: > Jul 05 20:59:13.761178 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: exception: Instance c6c3c1ea-31e8-4c65-b73d-669f337bee2f could not be found. Jul 05 20:59:13.761178 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: action_args: {'id': 'c6c3c1ea-31e8-4c65-b73d-669f337bee2f'} Jul 05 20:59:13.765412 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 05 20:59:13.765412 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 20:59:13.765412 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 05 20:59:13.765412 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 05 20:59:13.765412 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 05 20:59:13.765412 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 05 20:59:13.765412 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 05 20:59:13.765412 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 05 20:59:13.765412 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 05 20:59:13.765412 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 05 20:59:13.765412 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c6c3c1ea-31e8-4c65-b73d-669f337bee2f could not be found. Jul 05 20:59:13.765412 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi Jul 05 20:59:13.765412 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 20:59:13.765412 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi Jul 05 20:59:13.765412 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 20:59:13.765412 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 20:59:13.765412 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 20:59:13.765412 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 05 20:59:13.765412 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 05 20:59:13.765412 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 05 20:59:13.766852 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 05 20:59:13.766852 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 05 20:59:13.766852 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 05 20:59:13.766852 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 05 20:59:13.766852 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 05 20:59:13.766852 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 05 20:59:13.766852 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 05 20:59:13.766852 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c6c3c1ea-31e8-4c65-b73d-669f337bee2f could not be found. Jul 05 20:59:13.766852 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi Jul 05 20:59:13.766852 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 20:59:13.766852 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi Jul 05 20:59:13.766852 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 20:59:13.766852 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 20:59:13.766852 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 20:59:13.766852 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 05 20:59:13.766852 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 05 20:59:13.766852 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c6c3c1ea-31e8-4c65-b73d-669f337bee2f could not be found. Jul 05 20:59:13.766852 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi Jul 05 20:59:13.768902 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-da00da6c-3f5e-402e-80b8-de36b3e4006a tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Returning 404 to user: Instance c6c3c1ea-31e8-4c65-b73d-669f337bee2f could not be found. {{(pid=117627) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 05 20:59:13.768902 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-da00da6c-3f5e-402e-80b8-de36b3e4006a tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] 10.222.0.20 "GET /compute/v2.1/servers/c6c3c1ea-31e8-4c65-b73d-669f337bee2f" status: 404 len: 111 microversion: 2.1 time: 0.034888 Jul 05 20:59:13.768902 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 274/558] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:59:13 2022] GET /compute/v2.1/servers/c6c3c1ea-31e8-4c65-b73d-669f337bee2f => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 05 20:59:13.771091 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-0c09693f-acc9-46f5-8397-758eb0f784e7 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Calling method '.version_select at 0x7f57ce0995e0>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:59:13.792623 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-0c09693f-acc9-46f5-8397-758eb0f784e7 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1065538285" status: 202 len: 0 microversion: 2.1 time: 0.026753 Jul 05 20:59:13.793298 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 285/559] 10.222.0.20 () {58 vars in 1220 bytes} [Tue Jul 5 20:59:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1065538285 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 05 20:59:14.494125 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-37f21fd7-500a-4ac7-b1a3-8f25c8a8a52e tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:59:14.494694 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-37f21fd7-500a-4ac7-b1a3-8f25c8a8a52e tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] [instance: 7b18289e-137f-467c-96ec-cc6179f93e17] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:59:14.500789 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-37f21fd7-500a-4ac7-b1a3-8f25c8a8a52e tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:59:14.501263 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-37f21fd7-500a-4ac7-b1a3-8f25c8a8a52e tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:59:14.502006 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-37f21fd7-500a-4ac7-b1a3-8f25c8a8a52e tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:59:14.502432 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-37f21fd7-500a-4ac7-b1a3-8f25c8a8a52e tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:59:14.594151 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-e74759ec-8bb5-4049-bb2b-d6fbb81823fb tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:59:14.594755 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-e74759ec-8bb5-4049-bb2b-d6fbb81823fb tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] [instance: 6064b8b7-d821-4db1-86fa-c24015af68c7] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:59:14.600729 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-e74759ec-8bb5-4049-bb2b-d6fbb81823fb tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:59:14.601201 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-e74759ec-8bb5-4049-bb2b-d6fbb81823fb tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:59:14.601955 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-e74759ec-8bb5-4049-bb2b-d6fbb81823fb tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:59:14.602386 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-e74759ec-8bb5-4049-bb2b-d6fbb81823fb tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:59:14.637022 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-37f21fd7-500a-4ac7-b1a3-8f25c8a8a52e tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a4b471d14044069a5969e8bc6ca4f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3429e99ac2a94266b152e053bc6a0006', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:59:14.644846 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-37f21fd7-500a-4ac7-b1a3-8f25c8a8a52e tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] 10.222.0.20 "GET /compute/v2.1/servers/7b18289e-137f-467c-96ec-cc6179f93e17" status: 200 len: 1567 microversion: 2.1 time: 0.159333 Jul 05 20:59:14.645457 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 275/560] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:59:14 2022] GET /compute/v2.1/servers/7b18289e-137f-467c-96ec-cc6179f93e17 => generated 1567 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 20:59:14.734371 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-e74759ec-8bb5-4049-bb2b-d6fbb81823fb tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eac41ce3f04450b840cff305ec1a5ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47e1ad014d542f98f6b24c8a504d166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:59:14.742185 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-e74759ec-8bb5-4049-bb2b-d6fbb81823fb tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] 10.222.0.20 "GET /compute/v2.1/servers/6064b8b7-d821-4db1-86fa-c24015af68c7" status: 200 len: 1362 microversion: 2.1 time: 0.152241 Jul 05 20:59:14.742743 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 286/561] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:59:14 2022] GET /compute/v2.1/servers/6064b8b7-d821-4db1-86fa-c24015af68c7 => generated 1362 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 20:59:15.662443 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-92ac8a8b-d8fe-4431-b6e7-94e43cce118e tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:59:15.663076 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-92ac8a8b-d8fe-4431-b6e7-94e43cce118e tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] [instance: 7b18289e-137f-467c-96ec-cc6179f93e17] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:59:15.670244 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-92ac8a8b-d8fe-4431-b6e7-94e43cce118e tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:59:15.670686 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-92ac8a8b-d8fe-4431-b6e7-94e43cce118e tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:59:15.671431 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-92ac8a8b-d8fe-4431-b6e7-94e43cce118e tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:59:15.671860 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-92ac8a8b-d8fe-4431-b6e7-94e43cce118e tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:59:15.759326 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-3615dc4b-ffe6-4cf3-beb2-94d2be97684c tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:59:15.764162 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-3615dc4b-ffe6-4cf3-beb2-94d2be97684c tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] [instance: 6064b8b7-d821-4db1-86fa-c24015af68c7] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:59:15.767332 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-3615dc4b-ffe6-4cf3-beb2-94d2be97684c tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:59:15.767784 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-3615dc4b-ffe6-4cf3-beb2-94d2be97684c tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:59:15.768607 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-3615dc4b-ffe6-4cf3-beb2-94d2be97684c tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:59:15.769129 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-3615dc4b-ffe6-4cf3-beb2-94d2be97684c tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:59:15.819196 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-92ac8a8b-d8fe-4431-b6e7-94e43cce118e tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a4b471d14044069a5969e8bc6ca4f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3429e99ac2a94266b152e053bc6a0006', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:59:15.827194 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-92ac8a8b-d8fe-4431-b6e7-94e43cce118e tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] 10.222.0.20 "GET /compute/v2.1/servers/7b18289e-137f-467c-96ec-cc6179f93e17" status: 200 len: 1567 microversion: 2.1 time: 0.168628 Jul 05 20:59:15.827863 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 276/562] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:59:15 2022] GET /compute/v2.1/servers/7b18289e-137f-467c-96ec-cc6179f93e17 => generated 1567 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 20:59:15.914304 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-3615dc4b-ffe6-4cf3-beb2-94d2be97684c tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eac41ce3f04450b840cff305ec1a5ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47e1ad014d542f98f6b24c8a504d166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:59:15.922646 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-3615dc4b-ffe6-4cf3-beb2-94d2be97684c tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] 10.222.0.20 "GET /compute/v2.1/servers/6064b8b7-d821-4db1-86fa-c24015af68c7" status: 200 len: 1362 microversion: 2.1 time: 0.167109 Jul 05 20:59:15.923220 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 287/563] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:59:15 2022] GET /compute/v2.1/servers/6064b8b7-d821-4db1-86fa-c24015af68c7 => generated 1362 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 20:59:16.658363 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-c01908d0-cd94-49c1-9abb-90257fe6ea71 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:59:16.658795 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-c01908d0-cd94-49c1-9abb-90257fe6ea71 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] [instance: 82ec9293-050f-48f2-b0fd-e563145c6cb3] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:59:16.664834 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-c01908d0-cd94-49c1-9abb-90257fe6ea71 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:59:16.665992 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-c01908d0-cd94-49c1-9abb-90257fe6ea71 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:59:16.666583 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-c01908d0-cd94-49c1-9abb-90257fe6ea71 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:59:16.667015 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-c01908d0-cd94-49c1-9abb-90257fe6ea71 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:59:16.691773 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-c01908d0-cd94-49c1-9abb-90257fe6ea71 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] [instance: 82ec9293-050f-48f2-b0fd-e563145c6cb3] Going to try to terminate instance {{(pid=117627) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 05 20:59:16.764877 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-c01908d0-cd94-49c1-9abb-90257fe6ea71 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] 10.222.0.20 "DELETE /compute/v2.1/servers/82ec9293-050f-48f2-b0fd-e563145c6cb3" status: 204 len: 0 microversion: 2.1 time: 0.109994 Jul 05 20:59:16.765619 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 277/564] 10.222.0.20 () {58 vars in 1238 bytes} [Tue Jul 5 20:59:16 2022] DELETE /compute/v2.1/servers/82ec9293-050f-48f2-b0fd-e563145c6cb3 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 05 20:59:16.774187 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-0db466f6-9ecc-49be-bd42-f15d342feebc tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:59:16.775349 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-0db466f6-9ecc-49be-bd42-f15d342feebc tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] [instance: 82ec9293-050f-48f2-b0fd-e563145c6cb3] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:59:16.781898 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-0db466f6-9ecc-49be-bd42-f15d342feebc tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:59:16.782339 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-0db466f6-9ecc-49be-bd42-f15d342feebc tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:59:16.783094 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-0db466f6-9ecc-49be-bd42-f15d342feebc tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:59:16.783521 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-0db466f6-9ecc-49be-bd42-f15d342feebc tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:59:16.844433 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-924deab5-a464-46bc-9a33-e4ecf47ce1cc tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:59:16.845151 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-924deab5-a464-46bc-9a33-e4ecf47ce1cc tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] [instance: 7b18289e-137f-467c-96ec-cc6179f93e17] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:59:16.851161 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-924deab5-a464-46bc-9a33-e4ecf47ce1cc tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:59:16.851611 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-924deab5-a464-46bc-9a33-e4ecf47ce1cc tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:59:16.852366 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-924deab5-a464-46bc-9a33-e4ecf47ce1cc tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:59:16.853548 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-924deab5-a464-46bc-9a33-e4ecf47ce1cc tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:59:16.923572 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-0db466f6-9ecc-49be-bd42-f15d342feebc tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd152763a64794301b21587ab2b395bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc6d47f96d17471d94367bc8f8a3e3f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:59:16.931133 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-0db466f6-9ecc-49be-bd42-f15d342feebc tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] 10.222.0.20 "GET /compute/v2.1/servers/82ec9293-050f-48f2-b0fd-e563145c6cb3" status: 200 len: 1507 microversion: 2.1 time: 0.161147 Jul 05 20:59:16.931713 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 288/565] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:59:16 2022] GET /compute/v2.1/servers/82ec9293-050f-48f2-b0fd-e563145c6cb3 => generated 1507 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 20:59:16.945671 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-f36e5877-de68-4d62-9002-2a6b7693f028 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:59:16.946302 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-f36e5877-de68-4d62-9002-2a6b7693f028 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] [instance: 6064b8b7-d821-4db1-86fa-c24015af68c7] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:59:16.952527 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-f36e5877-de68-4d62-9002-2a6b7693f028 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:59:16.953006 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-f36e5877-de68-4d62-9002-2a6b7693f028 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:59:16.953778 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-f36e5877-de68-4d62-9002-2a6b7693f028 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:59:16.954211 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-f36e5877-de68-4d62-9002-2a6b7693f028 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:59:17.274168 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-924deab5-a464-46bc-9a33-e4ecf47ce1cc tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a4b471d14044069a5969e8bc6ca4f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3429e99ac2a94266b152e053bc6a0006', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:59:17.278880 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-f36e5877-de68-4d62-9002-2a6b7693f028 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eac41ce3f04450b840cff305ec1a5ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47e1ad014d542f98f6b24c8a504d166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:59:17.282458 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-924deab5-a464-46bc-9a33-e4ecf47ce1cc tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] 10.222.0.20 "GET /compute/v2.1/servers/7b18289e-137f-467c-96ec-cc6179f93e17" status: 200 len: 1567 microversion: 2.1 time: 0.442198 Jul 05 20:59:17.283030 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 278/566] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:59:16 2022] GET /compute/v2.1/servers/7b18289e-137f-467c-96ec-cc6179f93e17 => generated 1567 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 20:59:17.286505 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-f36e5877-de68-4d62-9002-2a6b7693f028 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] 10.222.0.20 "GET /compute/v2.1/servers/6064b8b7-d821-4db1-86fa-c24015af68c7" status: 200 len: 1362 microversion: 2.1 time: 0.344677 Jul 05 20:59:17.287061 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 289/567] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:59:16 2022] GET /compute/v2.1/servers/6064b8b7-d821-4db1-86fa-c24015af68c7 => generated 1362 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 20:59:17.947874 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-1338d63b-a172-4cf8-8028-0cdea21998b7 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:59:17.948475 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-1338d63b-a172-4cf8-8028-0cdea21998b7 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] [instance: 82ec9293-050f-48f2-b0fd-e563145c6cb3] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:59:17.955032 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-1338d63b-a172-4cf8-8028-0cdea21998b7 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:59:17.955480 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-1338d63b-a172-4cf8-8028-0cdea21998b7 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:59:17.956243 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-1338d63b-a172-4cf8-8028-0cdea21998b7 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:59:17.956680 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-1338d63b-a172-4cf8-8028-0cdea21998b7 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:59:18.082829 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-1338d63b-a172-4cf8-8028-0cdea21998b7 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd152763a64794301b21587ab2b395bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc6d47f96d17471d94367bc8f8a3e3f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:59:18.091004 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-1338d63b-a172-4cf8-8028-0cdea21998b7 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] 10.222.0.20 "GET /compute/v2.1/servers/82ec9293-050f-48f2-b0fd-e563145c6cb3" status: 200 len: 1507 microversion: 2.1 time: 0.147182 Jul 05 20:59:18.091574 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 279/568] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:59:17 2022] GET /compute/v2.1/servers/82ec9293-050f-48f2-b0fd-e563145c6cb3 => generated 1507 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 20:59:18.299472 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-90fe377e-e3c3-49e6-a632-18315a5edafa tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:59:18.300080 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-90fe377e-e3c3-49e6-a632-18315a5edafa tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] [instance: 7b18289e-137f-467c-96ec-cc6179f93e17] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:59:18.303255 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-8d0c882c-86e0-407d-9953-b8cf2a52c87c tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:59:18.303879 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-8d0c882c-86e0-407d-9953-b8cf2a52c87c tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] [instance: 6064b8b7-d821-4db1-86fa-c24015af68c7] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:59:18.307320 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-90fe377e-e3c3-49e6-a632-18315a5edafa tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:59:18.307766 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-90fe377e-e3c3-49e6-a632-18315a5edafa tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:59:18.308530 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-90fe377e-e3c3-49e6-a632-18315a5edafa tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:59:18.308982 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-90fe377e-e3c3-49e6-a632-18315a5edafa tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:59:18.310401 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-8d0c882c-86e0-407d-9953-b8cf2a52c87c tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:59:18.310852 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-8d0c882c-86e0-407d-9953-b8cf2a52c87c tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:59:18.311729 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-8d0c882c-86e0-407d-9953-b8cf2a52c87c tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:59:18.312169 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-8d0c882c-86e0-407d-9953-b8cf2a52c87c tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:59:18.510228 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-90fe377e-e3c3-49e6-a632-18315a5edafa tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a4b471d14044069a5969e8bc6ca4f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3429e99ac2a94266b152e053bc6a0006', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:59:18.513211 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-8d0c882c-86e0-407d-9953-b8cf2a52c87c tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eac41ce3f04450b840cff305ec1a5ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47e1ad014d542f98f6b24c8a504d166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:59:18.520149 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-90fe377e-e3c3-49e6-a632-18315a5edafa tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] 10.222.0.20 "GET /compute/v2.1/servers/7b18289e-137f-467c-96ec-cc6179f93e17" status: 200 len: 1567 microversion: 2.1 time: 0.224459 Jul 05 20:59:18.520890 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 290/569] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:59:18 2022] GET /compute/v2.1/servers/7b18289e-137f-467c-96ec-cc6179f93e17 => generated 1567 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 20:59:18.530591 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-8d0c882c-86e0-407d-9953-b8cf2a52c87c tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] 10.222.0.20 "GET /compute/v2.1/servers/6064b8b7-d821-4db1-86fa-c24015af68c7" status: 200 len: 1362 microversion: 2.1 time: 0.221703 Jul 05 20:59:18.531204 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 280/570] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:59:18 2022] GET /compute/v2.1/servers/6064b8b7-d821-4db1-86fa-c24015af68c7 => generated 1362 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 20:59:18.584782 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [req-1645bf38-9626-4181-9fc2-f915a0ce89a4 req-cdda0a04-daea-4ddc-a58a-4421307e354b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6064b8b7-d821-4db1-86fa-c24015af68c7", "name": "network-vif-plugged", "status": "completed", "tag": "e4577f63-e157-4dcd-b061-03b9dd87e83a"}]} {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 20:59:18.595503 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [req-1645bf38-9626-4181-9fc2-f915a0ce89a4 req-cdda0a04-daea-4ddc-a58a-4421307e354b service nova] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:59:18.595950 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [req-1645bf38-9626-4181-9fc2-f915a0ce89a4 req-cdda0a04-daea-4ddc-a58a-4421307e354b service nova] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:59:18.608504 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.compute.server_external_events [req-1645bf38-9626-4181-9fc2-f915a0ce89a4 req-cdda0a04-daea-4ddc-a58a-4421307e354b service nova] Creating event network-vif-plugged:e4577f63-e157-4dcd-b061-03b9dd87e83a for instance 6064b8b7-d821-4db1-86fa-c24015af68c7 on hv-cinder-79760 Jul 05 20:59:18.614376 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [req-1645bf38-9626-4181-9fc2-f915a0ce89a4 req-cdda0a04-daea-4ddc-a58a-4421307e354b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033276 Jul 05 20:59:18.614958 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 291/571] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 5 20:59:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 20:59:19.107571 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-37b9691c-a580-41de-b19b-511276a81321 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:59:19.108172 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-37b9691c-a580-41de-b19b-511276a81321 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] [instance: 82ec9293-050f-48f2-b0fd-e563145c6cb3] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:59:19.114723 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-37b9691c-a580-41de-b19b-511276a81321 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:59:19.115167 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-37b9691c-a580-41de-b19b-511276a81321 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:59:19.115919 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-37b9691c-a580-41de-b19b-511276a81321 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:59:19.116352 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-37b9691c-a580-41de-b19b-511276a81321 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:59:19.253854 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-37b9691c-a580-41de-b19b-511276a81321 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd152763a64794301b21587ab2b395bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc6d47f96d17471d94367bc8f8a3e3f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:59:19.263071 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-37b9691c-a580-41de-b19b-511276a81321 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] 10.222.0.20 "GET /compute/v2.1/servers/82ec9293-050f-48f2-b0fd-e563145c6cb3" status: 200 len: 1507 microversion: 2.1 time: 0.159261 Jul 05 20:59:19.263648 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 281/572] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:59:19 2022] GET /compute/v2.1/servers/82ec9293-050f-48f2-b0fd-e563145c6cb3 => generated 1507 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 20:59:19.538590 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-df02636a-93e2-4f8e-9dbf-5954b210dbb9 tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:59:19.539322 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-df02636a-93e2-4f8e-9dbf-5954b210dbb9 tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] [instance: 7b18289e-137f-467c-96ec-cc6179f93e17] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:59:19.547354 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-df02636a-93e2-4f8e-9dbf-5954b210dbb9 tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:59:19.547792 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-6a4bf79c-bd40-468a-a6ba-d8162f8710a2 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:59:19.547907 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-df02636a-93e2-4f8e-9dbf-5954b210dbb9 tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:59:19.548562 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-df02636a-93e2-4f8e-9dbf-5954b210dbb9 tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:59:19.548737 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-6a4bf79c-bd40-468a-a6ba-d8162f8710a2 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] [instance: 6064b8b7-d821-4db1-86fa-c24015af68c7] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:59:19.549022 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-df02636a-93e2-4f8e-9dbf-5954b210dbb9 tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:59:19.555426 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-6a4bf79c-bd40-468a-a6ba-d8162f8710a2 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:59:19.556820 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-6a4bf79c-bd40-468a-a6ba-d8162f8710a2 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:59:19.557689 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-6a4bf79c-bd40-468a-a6ba-d8162f8710a2 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:59:19.558226 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-6a4bf79c-bd40-468a-a6ba-d8162f8710a2 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:59:19.706856 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG dbcounter [-] [117627] Writing DB stats nova_cell0:SELECT=2 {{(pid=117627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:59:19.728152 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG dbcounter [-] [117627] Writing DB stats nova_cell0:SELECT=6 {{(pid=117627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:59:19.757070 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-df02636a-93e2-4f8e-9dbf-5954b210dbb9 tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a4b471d14044069a5969e8bc6ca4f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3429e99ac2a94266b152e053bc6a0006', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:59:19.763454 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-6a4bf79c-bd40-468a-a6ba-d8162f8710a2 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eac41ce3f04450b840cff305ec1a5ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47e1ad014d542f98f6b24c8a504d166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:59:19.771628 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-df02636a-93e2-4f8e-9dbf-5954b210dbb9 tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] 10.222.0.20 "GET /compute/v2.1/servers/7b18289e-137f-467c-96ec-cc6179f93e17" status: 200 len: 1567 microversion: 2.1 time: 0.236943 Jul 05 20:59:19.772416 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 292/573] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:59:19 2022] GET /compute/v2.1/servers/7b18289e-137f-467c-96ec-cc6179f93e17 => generated 1567 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 20:59:19.777888 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-6a4bf79c-bd40-468a-a6ba-d8162f8710a2 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] 10.222.0.20 "GET /compute/v2.1/servers/6064b8b7-d821-4db1-86fa-c24015af68c7" status: 200 len: 1362 microversion: 2.1 time: 0.234204 Jul 05 20:59:19.780827 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 282/574] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:59:19 2022] GET /compute/v2.1/servers/6064b8b7-d821-4db1-86fa-c24015af68c7 => generated 1362 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 20:59:19.941684 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [req-9e47c286-5135-4de9-a251-15ea4137f3b9 req-84d67e13-7336-4c48-8c38-052cb0a06809 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "82ec9293-050f-48f2-b0fd-e563145c6cb3", "name": "network-vif-deleted", "tag": "18b93783-3039-4fd9-b75c-752a99040bff"}]} {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 20:59:19.945125 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG dbcounter [-] [117628] Writing DB stats nova_cell0:SELECT=6 {{(pid=117628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:59:19.950814 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [req-9e47c286-5135-4de9-a251-15ea4137f3b9 req-84d67e13-7336-4c48-8c38-052cb0a06809 service nova] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:59:19.951251 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [req-9e47c286-5135-4de9-a251-15ea4137f3b9 req-84d67e13-7336-4c48-8c38-052cb0a06809 service nova] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:59:19.962947 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.compute.server_external_events [req-9e47c286-5135-4de9-a251-15ea4137f3b9 req-84d67e13-7336-4c48-8c38-052cb0a06809 service nova] Creating event network-vif-deleted:18b93783-3039-4fd9-b75c-752a99040bff for instance 82ec9293-050f-48f2-b0fd-e563145c6cb3 on hv-cinder-79760 Jul 05 20:59:19.967716 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [req-9e47c286-5135-4de9-a251-15ea4137f3b9 req-84d67e13-7336-4c48-8c38-052cb0a06809 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029618 Jul 05 20:59:19.968471 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 293/575] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 5 20:59:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 20:59:20.280515 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-56075d33-28a4-4f14-97fc-6b9eac327a62 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:59:20.281161 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-56075d33-28a4-4f14-97fc-6b9eac327a62 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] [instance: 82ec9293-050f-48f2-b0fd-e563145c6cb3] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:59:20.288206 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-56075d33-28a4-4f14-97fc-6b9eac327a62 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:59:20.288660 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-56075d33-28a4-4f14-97fc-6b9eac327a62 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:59:20.289461 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-56075d33-28a4-4f14-97fc-6b9eac327a62 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:59:20.290056 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-56075d33-28a4-4f14-97fc-6b9eac327a62 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:59:20.325302 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-56075d33-28a4-4f14-97fc-6b9eac327a62 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:59:20.326136 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-56075d33-28a4-4f14-97fc-6b9eac327a62 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:59:20.326827 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.objects.instance [None req-56075d33-28a4-4f14-97fc-6b9eac327a62 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lazy-loading 'fault' on Instance uuid 82ec9293-050f-48f2-b0fd-e563145c6cb3 {{(pid=117627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 05 20:59:20.374117 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-56075d33-28a4-4f14-97fc-6b9eac327a62 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd152763a64794301b21587ab2b395bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc6d47f96d17471d94367bc8f8a3e3f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:59:20.381619 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-56075d33-28a4-4f14-97fc-6b9eac327a62 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] 10.222.0.20 "GET /compute/v2.1/servers/82ec9293-050f-48f2-b0fd-e563145c6cb3" status: 200 len: 1311 microversion: 2.1 time: 0.105072 Jul 05 20:59:20.382178 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 283/576] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:59:20 2022] GET /compute/v2.1/servers/82ec9293-050f-48f2-b0fd-e563145c6cb3 => generated 1311 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 20:59:20.792598 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-3d3405d5-2339-42a2-b886-788135ad534b tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:59:20.795206 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-3d3405d5-2339-42a2-b886-788135ad534b tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] [instance: 7b18289e-137f-467c-96ec-cc6179f93e17] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:59:20.802039 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-351bb149-7083-45ce-a92c-ef87f2e02afe tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:59:20.807594 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-351bb149-7083-45ce-a92c-ef87f2e02afe tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] [instance: 6064b8b7-d821-4db1-86fa-c24015af68c7] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:59:20.811773 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-3d3405d5-2339-42a2-b886-788135ad534b tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:59:20.814734 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-3d3405d5-2339-42a2-b886-788135ad534b tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:59:20.818218 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-351bb149-7083-45ce-a92c-ef87f2e02afe tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:59:20.818662 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-351bb149-7083-45ce-a92c-ef87f2e02afe tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:59:20.819422 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-351bb149-7083-45ce-a92c-ef87f2e02afe tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:59:20.819851 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-351bb149-7083-45ce-a92c-ef87f2e02afe tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:59:20.821129 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-3d3405d5-2339-42a2-b886-788135ad534b tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:59:20.822083 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-3d3405d5-2339-42a2-b886-788135ad534b tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:59:21.020898 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-3d3405d5-2339-42a2-b886-788135ad534b tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a4b471d14044069a5969e8bc6ca4f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3429e99ac2a94266b152e053bc6a0006', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:59:21.025182 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-351bb149-7083-45ce-a92c-ef87f2e02afe tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eac41ce3f04450b840cff305ec1a5ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47e1ad014d542f98f6b24c8a504d166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:59:21.028909 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-3d3405d5-2339-42a2-b886-788135ad534b tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] 10.222.0.20 "GET /compute/v2.1/servers/7b18289e-137f-467c-96ec-cc6179f93e17" status: 200 len: 1567 microversion: 2.1 time: 0.242675 Jul 05 20:59:21.029502 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 294/577] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:59:20 2022] GET /compute/v2.1/servers/7b18289e-137f-467c-96ec-cc6179f93e17 => generated 1567 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 20:59:21.032881 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-351bb149-7083-45ce-a92c-ef87f2e02afe tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] 10.222.0.20 "GET /compute/v2.1/servers/6064b8b7-d821-4db1-86fa-c24015af68c7" status: 200 len: 1548 microversion: 2.1 time: 0.239225 Jul 05 20:59:21.033460 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 284/578] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:59:20 2022] GET /compute/v2.1/servers/6064b8b7-d821-4db1-86fa-c24015af68c7 => generated 1548 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 20:59:21.049023 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-cd6d18f6-fe6a-42a5-9fb9-61c67fa80b39 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:59:21.049593 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-cd6d18f6-fe6a-42a5-9fb9-61c67fa80b39 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] [instance: 6064b8b7-d821-4db1-86fa-c24015af68c7] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:59:21.056292 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-cd6d18f6-fe6a-42a5-9fb9-61c67fa80b39 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:59:21.056843 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-cd6d18f6-fe6a-42a5-9fb9-61c67fa80b39 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:59:21.057699 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-cd6d18f6-fe6a-42a5-9fb9-61c67fa80b39 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:59:21.058204 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-cd6d18f6-fe6a-42a5-9fb9-61c67fa80b39 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:59:21.137732 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-cd6d18f6-fe6a-42a5-9fb9-61c67fa80b39 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] 10.222.0.20 "GET /compute/v2.1/servers/6064b8b7-d821-4db1-86fa-c24015af68c7/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.092396 Jul 05 20:59:21.138326 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 295/579] 10.222.0.20 () {58 vars in 1274 bytes} [Tue Jul 5 20:59:21 2022] GET /compute/v2.1/servers/6064b8b7-d821-4db1-86fa-c24015af68c7/os-interface => generated 285 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 05 20:59:21.400870 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-a8bb438f-24fe-49d1-9fe5-9e61b9f7b484 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:59:21.403235 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-a8bb438f-24fe-49d1-9fe5-9e61b9f7b484 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] [instance: 82ec9293-050f-48f2-b0fd-e563145c6cb3] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:59:21.410614 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-a8bb438f-24fe-49d1-9fe5-9e61b9f7b484 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:59:21.411425 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-a8bb438f-24fe-49d1-9fe5-9e61b9f7b484 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:59:21.412418 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-a8bb438f-24fe-49d1-9fe5-9e61b9f7b484 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:59:21.413121 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-a8bb438f-24fe-49d1-9fe5-9e61b9f7b484 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:59:21.450425 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-a8bb438f-24fe-49d1-9fe5-9e61b9f7b484 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:59:21.450966 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-a8bb438f-24fe-49d1-9fe5-9e61b9f7b484 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:59:21.451476 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.objects.instance [None req-a8bb438f-24fe-49d1-9fe5-9e61b9f7b484 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lazy-loading 'fault' on Instance uuid 82ec9293-050f-48f2-b0fd-e563145c6cb3 {{(pid=117627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 05 20:59:21.517345 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-a8bb438f-24fe-49d1-9fe5-9e61b9f7b484 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd152763a64794301b21587ab2b395bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc6d47f96d17471d94367bc8f8a3e3f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:59:21.524916 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-a8bb438f-24fe-49d1-9fe5-9e61b9f7b484 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] 10.222.0.20 "GET /compute/v2.1/servers/82ec9293-050f-48f2-b0fd-e563145c6cb3" status: 200 len: 1311 microversion: 2.1 time: 0.128547 Jul 05 20:59:21.525581 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 285/580] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:59:21 2022] GET /compute/v2.1/servers/82ec9293-050f-48f2-b0fd-e563145c6cb3 => generated 1311 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 20:59:22.047363 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-8a0b78b5-75d4-4d40-91da-f51fe93fd7e5 tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:59:22.047974 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-8a0b78b5-75d4-4d40-91da-f51fe93fd7e5 tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] [instance: 7b18289e-137f-467c-96ec-cc6179f93e17] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:59:22.054866 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-8a0b78b5-75d4-4d40-91da-f51fe93fd7e5 tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:59:22.055314 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-8a0b78b5-75d4-4d40-91da-f51fe93fd7e5 tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:59:22.056658 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-8a0b78b5-75d4-4d40-91da-f51fe93fd7e5 tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:59:22.057127 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-8a0b78b5-75d4-4d40-91da-f51fe93fd7e5 tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:59:22.135820 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [req-f04f3c7e-7e5d-41c2-a8e6-44e0245da2d1 req-66c4d729-8c00-4be6-8b5a-31ec184daa1d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6064b8b7-d821-4db1-86fa-c24015af68c7", "tag": "e4577f63-e157-4dcd-b061-03b9dd87e83a"}]} {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 20:59:22.144787 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [req-f04f3c7e-7e5d-41c2-a8e6-44e0245da2d1 req-66c4d729-8c00-4be6-8b5a-31ec184daa1d service nova] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:59:22.145261 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [req-f04f3c7e-7e5d-41c2-a8e6-44e0245da2d1 req-66c4d729-8c00-4be6-8b5a-31ec184daa1d service nova] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:59:22.161796 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.compute.server_external_events [req-f04f3c7e-7e5d-41c2-a8e6-44e0245da2d1 req-66c4d729-8c00-4be6-8b5a-31ec184daa1d service nova] Creating event network-changed:e4577f63-e157-4dcd-b061-03b9dd87e83a for instance 6064b8b7-d821-4db1-86fa-c24015af68c7 on hv-cinder-79760 Jul 05 20:59:22.168864 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [req-f04f3c7e-7e5d-41c2-a8e6-44e0245da2d1 req-66c4d729-8c00-4be6-8b5a-31ec184daa1d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037275 Jul 05 20:59:22.169920 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 286/581] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 5 20:59:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 20:59:22.216806 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-8a0b78b5-75d4-4d40-91da-f51fe93fd7e5 tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a4b471d14044069a5969e8bc6ca4f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3429e99ac2a94266b152e053bc6a0006', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:59:22.224824 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-8a0b78b5-75d4-4d40-91da-f51fe93fd7e5 tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] 10.222.0.20 "GET /compute/v2.1/servers/7b18289e-137f-467c-96ec-cc6179f93e17" status: 200 len: 1567 microversion: 2.1 time: 0.181774 Jul 05 20:59:22.235846 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 296/582] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:59:22 2022] GET /compute/v2.1/servers/7b18289e-137f-467c-96ec-cc6179f93e17 => generated 1567 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 20:59:22.544911 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-7dd4be20-1dd1-471f-ae79-3c3a0baa454a tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:59:22.546469 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-7dd4be20-1dd1-471f-ae79-3c3a0baa454a tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] [instance: 82ec9293-050f-48f2-b0fd-e563145c6cb3] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:59:22.554201 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-7dd4be20-1dd1-471f-ae79-3c3a0baa454a tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:59:22.554970 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-7dd4be20-1dd1-471f-ae79-3c3a0baa454a tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:59:22.556696 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-7dd4be20-1dd1-471f-ae79-3c3a0baa454a tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:59:22.557396 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-7dd4be20-1dd1-471f-ae79-3c3a0baa454a tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:59:22.577885 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.wsgi [None req-7dd4be20-1dd1-471f-ae79-3c3a0baa454a tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] HTTP exception thrown: Instance 82ec9293-050f-48f2-b0fd-e563145c6cb3 could not be found. Jul 05 20:59:22.580098 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-7dd4be20-1dd1-471f-ae79-3c3a0baa454a tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Request method failure captured: Jul 05 20:59:22.580098 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: request: GET /compute/v2.1/servers/82ec9293-050f-48f2-b0fd-e563145c6cb3 HTTP/1.1 Jul 05 20:59:22.580098 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: Accept: application/json Jul 05 20:59:22.580098 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: Accept-Encoding: identity Jul 05 20:59:22.580098 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: Connection: close Jul 05 20:59:22.580098 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: Content-Length: 0 Jul 05 20:59:22.580098 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: Content-Type: application/json Jul 05 20:59:22.580098 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: Host: 10.222.0.20 Jul 05 20:59:22.580098 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: Openstack-System-Scope: None Jul 05 20:59:22.580098 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: User-Agent: python-urllib3/1.26.9 Jul 05 20:59:22.580098 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Auth-Token: gAAAAABixKUPNuH34QdH2KDVfn6Xq2ExRJFV_gfDikdto6Gtv-4vxOCZQ-cLxCvkxKeLcktJgVnSU2DRVovOt1N1tNauQsWgnI_IcnWeNaI2cc_3sRiAXqXL8oS987NWbN-5be6gxd3B2gK8PLp16_Qnn5ivzsTuuUNEU8MMiW1aGUc2_5VIMUQ Jul 05 20:59:22.580098 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Domain-Id: None Jul 05 20:59:22.580098 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Domain-Name: None Jul 05 20:59:22.580098 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Identity-Status: Confirmed Jul 05 20:59:22.580098 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Is-Admin-Project: True Jul 05 20:59:22.580098 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Project-Domain-Id: default Jul 05 20:59:22.580098 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Project-Domain-Name: Default Jul 05 20:59:22.580098 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Project-Id: fc6d47f96d17471d94367bc8f8a3e3f6 Jul 05 20:59:22.580098 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1951132500 Jul 05 20:59:22.580098 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Role: member,reader Jul 05 20:59:22.580098 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Roles: member,reader Jul 05 20:59:22.581441 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/fc6d47f96d17471d94367bc8f8a3e3f6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/fc6d47f96d17471d94367bc8f8a3e3f6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_fc6d47f96d17471d94367bc8f8a3e3f6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/fc6d47f96d17471d94367bc8f8a3e3f6"}]}] Jul 05 20:59:22.581441 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1951132500 Jul 05 20:59:22.581441 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Tenant-Id: fc6d47f96d17471d94367bc8f8a3e3f6 Jul 05 20:59:22.581441 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1951132500 Jul 05 20:59:22.581441 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-User: tempest-ServerRescueNegativeTestJSON-1951132500-project Jul 05 20:59:22.581441 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-User-Domain-Id: default Jul 05 20:59:22.581441 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-User-Domain-Name: Default Jul 05 20:59:22.581441 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-User-Id: d152763a64794301b21587ab2b395bbf Jul 05 20:59:22.581441 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1951132500-project Jul 05 20:59:22.581441 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: method: > Jul 05 20:59:22.581441 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: exception: Instance 82ec9293-050f-48f2-b0fd-e563145c6cb3 could not be found. Jul 05 20:59:22.581441 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: action_args: {'id': '82ec9293-050f-48f2-b0fd-e563145c6cb3'} Jul 05 20:59:22.582235 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 05 20:59:22.582235 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 20:59:22.582235 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 05 20:59:22.582235 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 05 20:59:22.582235 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 05 20:59:22.582235 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 05 20:59:22.582235 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 05 20:59:22.582235 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 05 20:59:22.582235 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 05 20:59:22.582235 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 05 20:59:22.582235 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 82ec9293-050f-48f2-b0fd-e563145c6cb3 could not be found. Jul 05 20:59:22.582235 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi Jul 05 20:59:22.582235 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 20:59:22.582235 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi Jul 05 20:59:22.582235 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 20:59:22.582235 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 20:59:22.582235 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 20:59:22.582235 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 05 20:59:22.582235 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 05 20:59:22.582235 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 05 20:59:22.583409 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 05 20:59:22.583409 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 05 20:59:22.583409 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 05 20:59:22.583409 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 05 20:59:22.583409 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 05 20:59:22.583409 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 05 20:59:22.583409 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 05 20:59:22.583409 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 82ec9293-050f-48f2-b0fd-e563145c6cb3 could not be found. Jul 05 20:59:22.583409 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi Jul 05 20:59:22.583409 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 20:59:22.583409 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi Jul 05 20:59:22.583409 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 20:59:22.583409 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 20:59:22.583409 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 20:59:22.583409 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 05 20:59:22.583409 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 05 20:59:22.583409 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 82ec9293-050f-48f2-b0fd-e563145c6cb3 could not be found. Jul 05 20:59:22.583409 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi Jul 05 20:59:22.587094 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-7dd4be20-1dd1-471f-ae79-3c3a0baa454a tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Returning 404 to user: Instance 82ec9293-050f-48f2-b0fd-e563145c6cb3 could not be found. {{(pid=117627) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 05 20:59:22.588857 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-7dd4be20-1dd1-471f-ae79-3c3a0baa454a tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] 10.222.0.20 "GET /compute/v2.1/servers/82ec9293-050f-48f2-b0fd-e563145c6cb3" status: 404 len: 111 microversion: 2.1 time: 0.049223 Jul 05 20:59:22.590022 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 287/583] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:59:22 2022] GET /compute/v2.1/servers/82ec9293-050f-48f2-b0fd-e563145c6cb3 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 05 20:59:22.599078 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-ca85bccd-a868-4f59-99f7-0d6a32b6618a tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:59:22.599580 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-ca85bccd-a868-4f59-99f7-0d6a32b6618a tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] [instance: a3aeae5c-d73d-4fb3-afa0-ee691e6a4fd4] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:59:22.606732 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-ca85bccd-a868-4f59-99f7-0d6a32b6618a tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:59:22.607449 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-ca85bccd-a868-4f59-99f7-0d6a32b6618a tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:59:22.608396 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-ca85bccd-a868-4f59-99f7-0d6a32b6618a tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:59:22.609045 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-ca85bccd-a868-4f59-99f7-0d6a32b6618a tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:59:22.635965 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-ca85bccd-a868-4f59-99f7-0d6a32b6618a tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] [instance: a3aeae5c-d73d-4fb3-afa0-ee691e6a4fd4] Going to try to terminate instance {{(pid=117628) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 05 20:59:22.734945 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-ca85bccd-a868-4f59-99f7-0d6a32b6618a tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] 10.222.0.20 "DELETE /compute/v2.1/servers/a3aeae5c-d73d-4fb3-afa0-ee691e6a4fd4" status: 204 len: 0 microversion: 2.1 time: 0.139110 Jul 05 20:59:22.735940 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 297/584] 10.222.0.20 () {58 vars in 1238 bytes} [Tue Jul 5 20:59:22 2022] DELETE /compute/v2.1/servers/a3aeae5c-d73d-4fb3-afa0-ee691e6a4fd4 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 05 20:59:22.745056 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-0186fc18-8b03-48a5-9ff6-efe46be511b3 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:59:22.745679 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-0186fc18-8b03-48a5-9ff6-efe46be511b3 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] [instance: a3aeae5c-d73d-4fb3-afa0-ee691e6a4fd4] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:59:22.752149 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-0186fc18-8b03-48a5-9ff6-efe46be511b3 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:59:22.752596 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-0186fc18-8b03-48a5-9ff6-efe46be511b3 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:59:22.753395 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-0186fc18-8b03-48a5-9ff6-efe46be511b3 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:59:22.753834 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-0186fc18-8b03-48a5-9ff6-efe46be511b3 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:59:22.771541 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG dbcounter [-] [117627] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:59:22.905038 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-0186fc18-8b03-48a5-9ff6-efe46be511b3 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd152763a64794301b21587ab2b395bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc6d47f96d17471d94367bc8f8a3e3f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:59:22.912553 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-0186fc18-8b03-48a5-9ff6-efe46be511b3 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] 10.222.0.20 "GET /compute/v2.1/servers/a3aeae5c-d73d-4fb3-afa0-ee691e6a4fd4" status: 200 len: 1523 microversion: 2.1 time: 0.172418 Jul 05 20:59:22.913171 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 288/585] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:59:22 2022] GET /compute/v2.1/servers/a3aeae5c-d73d-4fb3-afa0-ee691e6a4fd4 => generated 1523 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 20:59:23.243622 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-30881691-aa3e-4033-828e-13a52aef945c tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:59:23.244359 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-30881691-aa3e-4033-828e-13a52aef945c tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] [instance: 7b18289e-137f-467c-96ec-cc6179f93e17] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:59:23.250914 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-30881691-aa3e-4033-828e-13a52aef945c tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:59:23.251307 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-30881691-aa3e-4033-828e-13a52aef945c tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:59:23.252062 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-30881691-aa3e-4033-828e-13a52aef945c tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:59:23.252512 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-30881691-aa3e-4033-828e-13a52aef945c tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:59:23.387799 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-30881691-aa3e-4033-828e-13a52aef945c tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a4b471d14044069a5969e8bc6ca4f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3429e99ac2a94266b152e053bc6a0006', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:59:23.395206 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-30881691-aa3e-4033-828e-13a52aef945c tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] 10.222.0.20 "GET /compute/v2.1/servers/7b18289e-137f-467c-96ec-cc6179f93e17" status: 200 len: 1567 microversion: 2.1 time: 0.155953 Jul 05 20:59:23.395773 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 298/586] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:59:23 2022] GET /compute/v2.1/servers/7b18289e-137f-467c-96ec-cc6179f93e17 => generated 1567 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 20:59:23.931629 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-0a82e579-1fdd-4eed-861f-33e05059074f tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:59:23.932341 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-0a82e579-1fdd-4eed-861f-33e05059074f tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] [instance: a3aeae5c-d73d-4fb3-afa0-ee691e6a4fd4] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:59:23.940002 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-0a82e579-1fdd-4eed-861f-33e05059074f tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:59:23.940445 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-0a82e579-1fdd-4eed-861f-33e05059074f tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:59:23.941232 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-0a82e579-1fdd-4eed-861f-33e05059074f tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:59:23.941661 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-0a82e579-1fdd-4eed-861f-33e05059074f tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:59:24.070366 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-0a82e579-1fdd-4eed-861f-33e05059074f tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd152763a64794301b21587ab2b395bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc6d47f96d17471d94367bc8f8a3e3f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:59:24.078560 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-0a82e579-1fdd-4eed-861f-33e05059074f tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] 10.222.0.20 "GET /compute/v2.1/servers/a3aeae5c-d73d-4fb3-afa0-ee691e6a4fd4" status: 200 len: 1523 microversion: 2.1 time: 0.151652 Jul 05 20:59:24.079134 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 289/587] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:59:23 2022] GET /compute/v2.1/servers/a3aeae5c-d73d-4fb3-afa0-ee691e6a4fd4 => generated 1523 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 20:59:24.412959 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-ac800edf-8098-49ee-86af-1292d1cfb1e8 tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:59:24.413568 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-ac800edf-8098-49ee-86af-1292d1cfb1e8 tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] [instance: 7b18289e-137f-467c-96ec-cc6179f93e17] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:59:24.419631 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-ac800edf-8098-49ee-86af-1292d1cfb1e8 tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:59:24.420073 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-ac800edf-8098-49ee-86af-1292d1cfb1e8 tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:59:24.420821 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-ac800edf-8098-49ee-86af-1292d1cfb1e8 tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:59:24.421276 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-ac800edf-8098-49ee-86af-1292d1cfb1e8 tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:59:24.558626 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-ac800edf-8098-49ee-86af-1292d1cfb1e8 tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a4b471d14044069a5969e8bc6ca4f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3429e99ac2a94266b152e053bc6a0006', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:59:24.567571 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-ac800edf-8098-49ee-86af-1292d1cfb1e8 tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] 10.222.0.20 "GET /compute/v2.1/servers/7b18289e-137f-467c-96ec-cc6179f93e17" status: 200 len: 1567 microversion: 2.1 time: 0.158389 Jul 05 20:59:24.568140 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 299/588] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:59:24 2022] GET /compute/v2.1/servers/7b18289e-137f-467c-96ec-cc6179f93e17 => generated 1567 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 20:59:25.095524 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-d1af9bd6-9124-4826-a112-c851e07f273e tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:59:25.096124 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-d1af9bd6-9124-4826-a112-c851e07f273e tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] [instance: a3aeae5c-d73d-4fb3-afa0-ee691e6a4fd4] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:59:25.103308 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-d1af9bd6-9124-4826-a112-c851e07f273e tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:59:25.103742 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-d1af9bd6-9124-4826-a112-c851e07f273e tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:59:25.104491 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-d1af9bd6-9124-4826-a112-c851e07f273e tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:59:25.104923 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-d1af9bd6-9124-4826-a112-c851e07f273e tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:59:25.233098 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-d1af9bd6-9124-4826-a112-c851e07f273e tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd152763a64794301b21587ab2b395bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc6d47f96d17471d94367bc8f8a3e3f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:59:25.240697 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-d1af9bd6-9124-4826-a112-c851e07f273e tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] 10.222.0.20 "GET /compute/v2.1/servers/a3aeae5c-d73d-4fb3-afa0-ee691e6a4fd4" status: 200 len: 1523 microversion: 2.1 time: 0.149082 Jul 05 20:59:25.241292 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 290/589] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:59:25 2022] GET /compute/v2.1/servers/a3aeae5c-d73d-4fb3-afa0-ee691e6a4fd4 => generated 1523 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 20:59:25.585795 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-602b5c1c-58a8-425e-be23-4f067fa8887c tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:59:25.587025 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-602b5c1c-58a8-425e-be23-4f067fa8887c tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] [instance: 7b18289e-137f-467c-96ec-cc6179f93e17] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:59:25.593908 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-602b5c1c-58a8-425e-be23-4f067fa8887c tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:59:25.594350 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-602b5c1c-58a8-425e-be23-4f067fa8887c tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:59:25.595105 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-602b5c1c-58a8-425e-be23-4f067fa8887c tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:59:25.595538 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-602b5c1c-58a8-425e-be23-4f067fa8887c tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:59:25.726885 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-602b5c1c-58a8-425e-be23-4f067fa8887c tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a4b471d14044069a5969e8bc6ca4f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3429e99ac2a94266b152e053bc6a0006', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:59:25.734430 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-602b5c1c-58a8-425e-be23-4f067fa8887c tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] 10.222.0.20 "GET /compute/v2.1/servers/7b18289e-137f-467c-96ec-cc6179f93e17" status: 200 len: 1567 microversion: 2.1 time: 0.152446 Jul 05 20:59:25.734991 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 300/590] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:59:25 2022] GET /compute/v2.1/servers/7b18289e-137f-467c-96ec-cc6179f93e17 => generated 1567 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 20:59:26.257424 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-1f54cb58-381d-4001-b6cd-2fbb597a5c67 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:59:26.258007 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-1f54cb58-381d-4001-b6cd-2fbb597a5c67 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] [instance: a3aeae5c-d73d-4fb3-afa0-ee691e6a4fd4] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:59:26.264523 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-1f54cb58-381d-4001-b6cd-2fbb597a5c67 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:59:26.264983 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-1f54cb58-381d-4001-b6cd-2fbb597a5c67 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:59:26.265729 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-1f54cb58-381d-4001-b6cd-2fbb597a5c67 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:59:26.266156 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-1f54cb58-381d-4001-b6cd-2fbb597a5c67 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:59:26.395593 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-1f54cb58-381d-4001-b6cd-2fbb597a5c67 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd152763a64794301b21587ab2b395bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc6d47f96d17471d94367bc8f8a3e3f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:59:26.403930 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-1f54cb58-381d-4001-b6cd-2fbb597a5c67 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] 10.222.0.20 "GET /compute/v2.1/servers/a3aeae5c-d73d-4fb3-afa0-ee691e6a4fd4" status: 200 len: 1523 microversion: 2.1 time: 0.150341 Jul 05 20:59:26.404481 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 291/591] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:59:26 2022] GET /compute/v2.1/servers/a3aeae5c-d73d-4fb3-afa0-ee691e6a4fd4 => generated 1523 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 20:59:26.752004 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-84911fd9-abf5-4bd1-8894-2e7e34bf9bec tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:59:26.752613 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-84911fd9-abf5-4bd1-8894-2e7e34bf9bec tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] [instance: 7b18289e-137f-467c-96ec-cc6179f93e17] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:59:26.755109 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG dbcounter [-] [117628] Writing DB stats nova_api:SELECT=89,nova_api:DELETE=2,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=117628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:59:26.762000 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-84911fd9-abf5-4bd1-8894-2e7e34bf9bec tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:59:26.762447 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-84911fd9-abf5-4bd1-8894-2e7e34bf9bec tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:59:26.763218 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-84911fd9-abf5-4bd1-8894-2e7e34bf9bec tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:59:26.763655 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-84911fd9-abf5-4bd1-8894-2e7e34bf9bec tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:59:26.780288 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG dbcounter [-] [117628] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:59:26.898459 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-84911fd9-abf5-4bd1-8894-2e7e34bf9bec tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a4b471d14044069a5969e8bc6ca4f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3429e99ac2a94266b152e053bc6a0006', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:59:26.905926 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-84911fd9-abf5-4bd1-8894-2e7e34bf9bec tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] 10.222.0.20 "GET /compute/v2.1/servers/7b18289e-137f-467c-96ec-cc6179f93e17" status: 200 len: 1567 microversion: 2.1 time: 0.157765 Jul 05 20:59:26.906495 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 301/592] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:59:26 2022] GET /compute/v2.1/servers/7b18289e-137f-467c-96ec-cc6179f93e17 => generated 1567 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 20:59:27.419700 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-9ef9c846-7fb6-4fe7-b119-86a816d0c755 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:59:27.420882 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-9ef9c846-7fb6-4fe7-b119-86a816d0c755 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] [instance: a3aeae5c-d73d-4fb3-afa0-ee691e6a4fd4] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:59:27.427528 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-9ef9c846-7fb6-4fe7-b119-86a816d0c755 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:59:27.428148 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-9ef9c846-7fb6-4fe7-b119-86a816d0c755 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:59:27.429139 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-9ef9c846-7fb6-4fe7-b119-86a816d0c755 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:59:27.429775 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-9ef9c846-7fb6-4fe7-b119-86a816d0c755 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:59:27.652819 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-9ef9c846-7fb6-4fe7-b119-86a816d0c755 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd152763a64794301b21587ab2b395bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc6d47f96d17471d94367bc8f8a3e3f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:59:27.660570 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-9ef9c846-7fb6-4fe7-b119-86a816d0c755 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] 10.222.0.20 "GET /compute/v2.1/servers/a3aeae5c-d73d-4fb3-afa0-ee691e6a4fd4" status: 200 len: 1523 microversion: 2.1 time: 0.244700 Jul 05 20:59:27.661559 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 292/593] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:59:27 2022] GET /compute/v2.1/servers/a3aeae5c-d73d-4fb3-afa0-ee691e6a4fd4 => generated 1523 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 20:59:27.888465 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [req-a392a4eb-0f32-42ec-aaa7-225648ca07e4 req-62679d35-11b6-4ea2-a5fb-ab2232fdd76a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3aeae5c-d73d-4fb3-afa0-ee691e6a4fd4", "name": "network-vif-deleted", "tag": "9d4d8d62-90d7-4b09-8e51-523c69e6c012"}]} {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 20:59:27.897239 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [req-a392a4eb-0f32-42ec-aaa7-225648ca07e4 req-62679d35-11b6-4ea2-a5fb-ab2232fdd76a service nova] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:59:27.897841 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [req-a392a4eb-0f32-42ec-aaa7-225648ca07e4 req-62679d35-11b6-4ea2-a5fb-ab2232fdd76a service nova] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:59:27.908675 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.compute.server_external_events [req-a392a4eb-0f32-42ec-aaa7-225648ca07e4 req-62679d35-11b6-4ea2-a5fb-ab2232fdd76a service nova] Creating event network-vif-deleted:9d4d8d62-90d7-4b09-8e51-523c69e6c012 for instance a3aeae5c-d73d-4fb3-afa0-ee691e6a4fd4 on hv-cinder-79760 Jul 05 20:59:27.913388 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [req-a392a4eb-0f32-42ec-aaa7-225648ca07e4 req-62679d35-11b6-4ea2-a5fb-ab2232fdd76a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028707 Jul 05 20:59:27.913965 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 302/594] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 5 20:59:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 20:59:27.923373 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-a01e7854-f7de-4602-9d43-98d811430a27 tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:59:27.923982 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-a01e7854-f7de-4602-9d43-98d811430a27 tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] [instance: 7b18289e-137f-467c-96ec-cc6179f93e17] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:59:27.930600 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-a01e7854-f7de-4602-9d43-98d811430a27 tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:59:27.931040 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-a01e7854-f7de-4602-9d43-98d811430a27 tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:59:27.931793 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-a01e7854-f7de-4602-9d43-98d811430a27 tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:59:27.932227 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-a01e7854-f7de-4602-9d43-98d811430a27 tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:59:28.065684 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-a01e7854-f7de-4602-9d43-98d811430a27 tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a4b471d14044069a5969e8bc6ca4f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3429e99ac2a94266b152e053bc6a0006', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:59:28.073316 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-a01e7854-f7de-4602-9d43-98d811430a27 tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] 10.222.0.20 "GET /compute/v2.1/servers/7b18289e-137f-467c-96ec-cc6179f93e17" status: 200 len: 1568 microversion: 2.1 time: 0.153725 Jul 05 20:59:28.073883 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 293/595] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:59:27 2022] GET /compute/v2.1/servers/7b18289e-137f-467c-96ec-cc6179f93e17 => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 20:59:28.090581 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-f727a3fa-bf56-41d7-b0c6-91035a0807a6 tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 20:59:28.091238 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-f727a3fa-bf56-41d7-b0c6-91035a0807a6 tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] [instance: 7b18289e-137f-467c-96ec-cc6179f93e17] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:59:28.097610 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-f727a3fa-bf56-41d7-b0c6-91035a0807a6 tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:59:28.098279 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-f727a3fa-bf56-41d7-b0c6-91035a0807a6 tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:59:28.099046 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-f727a3fa-bf56-41d7-b0c6-91035a0807a6 tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:59:28.099486 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-f727a3fa-bf56-41d7-b0c6-91035a0807a6 tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:59:28.198610 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-f727a3fa-bf56-41d7-b0c6-91035a0807a6 tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] 10.222.0.20 "POST /compute/v2.1/servers/7b18289e-137f-467c-96ec-cc6179f93e17/action" status: 202 len: 0 microversion: 2.1 time: 0.112697 Jul 05 20:59:28.202358 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 303/596] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Jul 5 20:59:28 2022] POST /compute/v2.1/servers/7b18289e-137f-467c-96ec-cc6179f93e17/action => generated 0 bytes in 114 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 05 20:59:28.208618 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-22f78eb7-e0b2-4770-8e72-abba91f0f2ec tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:59:28.210028 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-22f78eb7-e0b2-4770-8e72-abba91f0f2ec tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] [instance: 7b18289e-137f-467c-96ec-cc6179f93e17] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:59:28.215021 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG dbcounter [-] [117627] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=117627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:59:28.220053 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-22f78eb7-e0b2-4770-8e72-abba91f0f2ec tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:59:28.220635 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-22f78eb7-e0b2-4770-8e72-abba91f0f2ec tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:59:28.221712 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-22f78eb7-e0b2-4770-8e72-abba91f0f2ec tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:59:28.223311 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-22f78eb7-e0b2-4770-8e72-abba91f0f2ec tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:59:28.395859 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-22f78eb7-e0b2-4770-8e72-abba91f0f2ec tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a4b471d14044069a5969e8bc6ca4f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3429e99ac2a94266b152e053bc6a0006', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:59:28.404672 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-22f78eb7-e0b2-4770-8e72-abba91f0f2ec tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] 10.222.0.20 "GET /compute/v2.1/servers/7b18289e-137f-467c-96ec-cc6179f93e17" status: 200 len: 1516 microversion: 2.1 time: 0.200397 Jul 05 20:59:28.405306 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 294/597] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:59:28 2022] GET /compute/v2.1/servers/7b18289e-137f-467c-96ec-cc6179f93e17 => generated 1516 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 20:59:28.603934 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [req-8b26d088-5e1a-4d0c-bfe3-76b393c98792 req-0e58a13e-e041-4d2b-bf6e-8fe53097d4eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b18289e-137f-467c-96ec-cc6179f93e17", "name": "network-vif-unplugged", "status": "completed", "tag": "6b603e35-d2c5-47fc-83a0-12c2780e086f"}]} {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 20:59:28.614441 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [req-8b26d088-5e1a-4d0c-bfe3-76b393c98792 req-0e58a13e-e041-4d2b-bf6e-8fe53097d4eb service nova] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:59:28.627395 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [req-8b26d088-5e1a-4d0c-bfe3-76b393c98792 req-0e58a13e-e041-4d2b-bf6e-8fe53097d4eb service nova] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:59:28.664502 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.compute.server_external_events [req-8b26d088-5e1a-4d0c-bfe3-76b393c98792 req-0e58a13e-e041-4d2b-bf6e-8fe53097d4eb service nova] Unable to find a host for instance 7b18289e-137f-467c-96ec-cc6179f93e17. Dropping event network-vif-unplugged {{(pid=117628) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jul 05 20:59:28.665652 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [req-8b26d088-5e1a-4d0c-bfe3-76b393c98792 req-0e58a13e-e041-4d2b-bf6e-8fe53097d4eb service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.067321 Jul 05 20:59:28.666551 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 304/598] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 5 20:59:28 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 69 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jul 05 20:59:28.679581 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-48885e36-c940-4efa-8825-3b276f43e40e tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:59:28.681484 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-48885e36-c940-4efa-8825-3b276f43e40e tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] [instance: a3aeae5c-d73d-4fb3-afa0-ee691e6a4fd4] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:59:28.688446 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-48885e36-c940-4efa-8825-3b276f43e40e tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:59:28.688904 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-48885e36-c940-4efa-8825-3b276f43e40e tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:59:28.689696 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-48885e36-c940-4efa-8825-3b276f43e40e tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:59:28.690127 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-48885e36-c940-4efa-8825-3b276f43e40e tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:59:28.736988 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-48885e36-c940-4efa-8825-3b276f43e40e tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:59:28.737753 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-48885e36-c940-4efa-8825-3b276f43e40e tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:59:28.738357 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.objects.instance [None req-48885e36-c940-4efa-8825-3b276f43e40e tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lazy-loading 'fault' on Instance uuid a3aeae5c-d73d-4fb3-afa0-ee691e6a4fd4 {{(pid=117627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 05 20:59:28.790864 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-48885e36-c940-4efa-8825-3b276f43e40e tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd152763a64794301b21587ab2b395bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc6d47f96d17471d94367bc8f8a3e3f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:59:28.798815 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-48885e36-c940-4efa-8825-3b276f43e40e tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] 10.222.0.20 "GET /compute/v2.1/servers/a3aeae5c-d73d-4fb3-afa0-ee691e6a4fd4" status: 200 len: 1312 microversion: 2.1 time: 0.124243 Jul 05 20:59:28.799397 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 295/599] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:59:28 2022] GET /compute/v2.1/servers/a3aeae5c-d73d-4fb3-afa0-ee691e6a4fd4 => generated 1312 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 20:59:29.421856 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-332b6605-86a8-41a8-ac60-f7797590e172 tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:59:29.422460 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-332b6605-86a8-41a8-ac60-f7797590e172 tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] [instance: 7b18289e-137f-467c-96ec-cc6179f93e17] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:59:29.429361 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-332b6605-86a8-41a8-ac60-f7797590e172 tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:59:29.429813 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-332b6605-86a8-41a8-ac60-f7797590e172 tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:59:29.431286 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-332b6605-86a8-41a8-ac60-f7797590e172 tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:59:29.431726 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-332b6605-86a8-41a8-ac60-f7797590e172 tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:59:29.564707 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-332b6605-86a8-41a8-ac60-f7797590e172 tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a4b471d14044069a5969e8bc6ca4f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3429e99ac2a94266b152e053bc6a0006', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:59:29.572697 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-332b6605-86a8-41a8-ac60-f7797590e172 tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] 10.222.0.20 "GET /compute/v2.1/servers/7b18289e-137f-467c-96ec-cc6179f93e17" status: 200 len: 1518 microversion: 2.1 time: 0.154653 Jul 05 20:59:29.573549 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 305/600] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:59:29 2022] GET /compute/v2.1/servers/7b18289e-137f-467c-96ec-cc6179f93e17 => generated 1518 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 20:59:29.816176 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-2f6c8c4a-e954-4bf6-8072-5f7fda400ea8 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:59:29.816772 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-2f6c8c4a-e954-4bf6-8072-5f7fda400ea8 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] [instance: a3aeae5c-d73d-4fb3-afa0-ee691e6a4fd4] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:59:29.825439 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-2f6c8c4a-e954-4bf6-8072-5f7fda400ea8 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:59:29.825881 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-2f6c8c4a-e954-4bf6-8072-5f7fda400ea8 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:59:29.826634 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-2f6c8c4a-e954-4bf6-8072-5f7fda400ea8 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:59:29.827121 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-2f6c8c4a-e954-4bf6-8072-5f7fda400ea8 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:59:29.841727 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.wsgi [None req-2f6c8c4a-e954-4bf6-8072-5f7fda400ea8 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] HTTP exception thrown: Instance a3aeae5c-d73d-4fb3-afa0-ee691e6a4fd4 could not be found. Jul 05 20:59:29.843262 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-2f6c8c4a-e954-4bf6-8072-5f7fda400ea8 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Request method failure captured: Jul 05 20:59:29.843262 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: request: GET /compute/v2.1/servers/a3aeae5c-d73d-4fb3-afa0-ee691e6a4fd4 HTTP/1.1 Jul 05 20:59:29.843262 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: Accept: application/json Jul 05 20:59:29.843262 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: Accept-Encoding: identity Jul 05 20:59:29.843262 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: Connection: close Jul 05 20:59:29.843262 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: Content-Length: 0 Jul 05 20:59:29.843262 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: Content-Type: application/json Jul 05 20:59:29.843262 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: Host: 10.222.0.20 Jul 05 20:59:29.843262 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: Openstack-System-Scope: None Jul 05 20:59:29.843262 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: User-Agent: python-urllib3/1.26.9 Jul 05 20:59:29.843262 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Auth-Token: gAAAAABixKUPNuH34QdH2KDVfn6Xq2ExRJFV_gfDikdto6Gtv-4vxOCZQ-cLxCvkxKeLcktJgVnSU2DRVovOt1N1tNauQsWgnI_IcnWeNaI2cc_3sRiAXqXL8oS987NWbN-5be6gxd3B2gK8PLp16_Qnn5ivzsTuuUNEU8MMiW1aGUc2_5VIMUQ Jul 05 20:59:29.843262 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Domain-Id: None Jul 05 20:59:29.843262 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Domain-Name: None Jul 05 20:59:29.843262 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Identity-Status: Confirmed Jul 05 20:59:29.843262 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Is-Admin-Project: True Jul 05 20:59:29.843262 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Project-Domain-Id: default Jul 05 20:59:29.843262 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Project-Domain-Name: Default Jul 05 20:59:29.843262 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Project-Id: fc6d47f96d17471d94367bc8f8a3e3f6 Jul 05 20:59:29.843262 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1951132500 Jul 05 20:59:29.843262 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Role: member,reader Jul 05 20:59:29.843262 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Roles: member,reader Jul 05 20:59:29.845842 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/fc6d47f96d17471d94367bc8f8a3e3f6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/fc6d47f96d17471d94367bc8f8a3e3f6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_fc6d47f96d17471d94367bc8f8a3e3f6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/fc6d47f96d17471d94367bc8f8a3e3f6"}]}] Jul 05 20:59:29.845842 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1951132500 Jul 05 20:59:29.845842 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Tenant-Id: fc6d47f96d17471d94367bc8f8a3e3f6 Jul 05 20:59:29.845842 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1951132500 Jul 05 20:59:29.845842 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-User: tempest-ServerRescueNegativeTestJSON-1951132500-project Jul 05 20:59:29.845842 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-User-Domain-Id: default Jul 05 20:59:29.845842 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-User-Domain-Name: Default Jul 05 20:59:29.845842 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-User-Id: d152763a64794301b21587ab2b395bbf Jul 05 20:59:29.845842 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1951132500-project Jul 05 20:59:29.845842 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: method: > Jul 05 20:59:29.845842 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: exception: Instance a3aeae5c-d73d-4fb3-afa0-ee691e6a4fd4 could not be found. Jul 05 20:59:29.845842 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: action_args: {'id': 'a3aeae5c-d73d-4fb3-afa0-ee691e6a4fd4'} Jul 05 20:59:29.847484 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 05 20:59:29.847484 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 20:59:29.847484 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 05 20:59:29.847484 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 05 20:59:29.847484 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 05 20:59:29.847484 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 05 20:59:29.847484 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 05 20:59:29.847484 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 05 20:59:29.847484 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 05 20:59:29.847484 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 05 20:59:29.847484 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a3aeae5c-d73d-4fb3-afa0-ee691e6a4fd4 could not be found. Jul 05 20:59:29.847484 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi Jul 05 20:59:29.847484 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 20:59:29.847484 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi Jul 05 20:59:29.847484 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 20:59:29.847484 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 20:59:29.847484 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 20:59:29.847484 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 05 20:59:29.847484 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 05 20:59:29.847484 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 05 20:59:29.850227 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 05 20:59:29.850227 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 05 20:59:29.850227 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 05 20:59:29.850227 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 05 20:59:29.850227 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 05 20:59:29.850227 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 05 20:59:29.850227 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 05 20:59:29.850227 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a3aeae5c-d73d-4fb3-afa0-ee691e6a4fd4 could not be found. Jul 05 20:59:29.850227 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi Jul 05 20:59:29.850227 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 20:59:29.850227 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi Jul 05 20:59:29.850227 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 20:59:29.850227 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 20:59:29.850227 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 20:59:29.850227 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 05 20:59:29.850227 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 05 20:59:29.850227 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a3aeae5c-d73d-4fb3-afa0-ee691e6a4fd4 could not be found. Jul 05 20:59:29.850227 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi Jul 05 20:59:29.852328 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-2f6c8c4a-e954-4bf6-8072-5f7fda400ea8 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] Returning 404 to user: Instance a3aeae5c-d73d-4fb3-afa0-ee691e6a4fd4 could not be found. {{(pid=117627) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 05 20:59:29.852328 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-2f6c8c4a-e954-4bf6-8072-5f7fda400ea8 tempest-ServerRescueNegativeTestJSON-1951132500 tempest-ServerRescueNegativeTestJSON-1951132500-project] 10.222.0.20 "GET /compute/v2.1/servers/a3aeae5c-d73d-4fb3-afa0-ee691e6a4fd4" status: 404 len: 111 microversion: 2.1 time: 0.032343 Jul 05 20:59:29.852328 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 296/601] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:59:29 2022] GET /compute/v2.1/servers/a3aeae5c-d73d-4fb3-afa0-ee691e6a4fd4 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 05 20:59:30.590711 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-8cab02fe-f762-4999-b373-cbeb6213ddbf tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:59:30.591309 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-8cab02fe-f762-4999-b373-cbeb6213ddbf tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] [instance: 7b18289e-137f-467c-96ec-cc6179f93e17] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:59:30.598015 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-8cab02fe-f762-4999-b373-cbeb6213ddbf tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:59:30.598447 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-8cab02fe-f762-4999-b373-cbeb6213ddbf tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:59:30.599226 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-8cab02fe-f762-4999-b373-cbeb6213ddbf tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:59:30.599656 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-8cab02fe-f762-4999-b373-cbeb6213ddbf tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:59:31.077640 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-8cab02fe-f762-4999-b373-cbeb6213ddbf tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a4b471d14044069a5969e8bc6ca4f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3429e99ac2a94266b152e053bc6a0006', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:59:31.090202 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-8cab02fe-f762-4999-b373-cbeb6213ddbf tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] 10.222.0.20 "GET /compute/v2.1/servers/7b18289e-137f-467c-96ec-cc6179f93e17" status: 200 len: 1574 microversion: 2.1 time: 0.504006 Jul 05 20:59:31.091065 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 306/602] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:59:30 2022] GET /compute/v2.1/servers/7b18289e-137f-467c-96ec-cc6179f93e17 => generated 1574 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 20:59:32.108043 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-fd1e6319-affa-4403-90a3-777b7dc8eea1 tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:59:32.109464 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-fd1e6319-affa-4403-90a3-777b7dc8eea1 tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] [instance: 7b18289e-137f-467c-96ec-cc6179f93e17] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:59:32.116402 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-fd1e6319-affa-4403-90a3-777b7dc8eea1 tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:59:32.116923 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-fd1e6319-affa-4403-90a3-777b7dc8eea1 tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:59:32.118080 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-fd1e6319-affa-4403-90a3-777b7dc8eea1 tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:59:32.118617 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-fd1e6319-affa-4403-90a3-777b7dc8eea1 tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:59:32.272957 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-fd1e6319-affa-4403-90a3-777b7dc8eea1 tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a4b471d14044069a5969e8bc6ca4f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3429e99ac2a94266b152e053bc6a0006', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:59:32.281188 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-fd1e6319-affa-4403-90a3-777b7dc8eea1 tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] 10.222.0.20 "GET /compute/v2.1/servers/7b18289e-137f-467c-96ec-cc6179f93e17" status: 200 len: 1574 microversion: 2.1 time: 0.177229 Jul 05 20:59:32.281741 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 297/603] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:59:32 2022] GET /compute/v2.1/servers/7b18289e-137f-467c-96ec-cc6179f93e17 => generated 1574 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 20:59:33.003127 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-815db9a8-f5a4-41ee-9439-4ad3b5b567d1 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:59:33.003654 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-815db9a8-f5a4-41ee-9439-4ad3b5b567d1 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] [instance: 1b6eabe8-54b0-43cf-94ff-9d4abc8168db] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:59:33.010153 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-815db9a8-f5a4-41ee-9439-4ad3b5b567d1 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:59:33.010598 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-815db9a8-f5a4-41ee-9439-4ad3b5b567d1 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:59:33.011364 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-815db9a8-f5a4-41ee-9439-4ad3b5b567d1 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:59:33.011821 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-815db9a8-f5a4-41ee-9439-4ad3b5b567d1 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:59:33.040791 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-815db9a8-f5a4-41ee-9439-4ad3b5b567d1 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] 10.222.0.20 "GET /compute/v2.1/servers/1b6eabe8-54b0-43cf-94ff-9d4abc8168db/ips" status: 200 len: 151 microversion: 2.20 time: 0.041780 Jul 05 20:59:33.041392 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 307/604] 10.222.0.20 () {60 vars in 1288 bytes} [Tue Jul 5 20:59:32 2022] GET /compute/v2.1/servers/1b6eabe8-54b0-43cf-94ff-9d4abc8168db/ips => generated 151 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 05 20:59:33.300220 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-ead11734-c653-4528-9de2-be6c7e4f1523 tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:59:33.300955 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-ead11734-c653-4528-9de2-be6c7e4f1523 tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] [instance: 7b18289e-137f-467c-96ec-cc6179f93e17] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:59:33.319186 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-ead11734-c653-4528-9de2-be6c7e4f1523 tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:59:33.319918 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-ead11734-c653-4528-9de2-be6c7e4f1523 tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:59:33.320896 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-ead11734-c653-4528-9de2-be6c7e4f1523 tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:59:33.321674 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-ead11734-c653-4528-9de2-be6c7e4f1523 tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:59:33.490519 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-ead11734-c653-4528-9de2-be6c7e4f1523 tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a4b471d14044069a5969e8bc6ca4f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3429e99ac2a94266b152e053bc6a0006', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:59:33.496654 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-ead11734-c653-4528-9de2-be6c7e4f1523 tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] 10.222.0.20 "GET /compute/v2.1/servers/7b18289e-137f-467c-96ec-cc6179f93e17" status: 200 len: 1574 microversion: 2.1 time: 0.202033 Jul 05 20:59:33.497261 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 298/605] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:59:33 2022] GET /compute/v2.1/servers/7b18289e-137f-467c-96ec-cc6179f93e17 => generated 1574 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 20:59:34.514731 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-51ea7c50-1e3f-46ba-bdaf-046e2b724f62 tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:59:34.515439 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-51ea7c50-1e3f-46ba-bdaf-046e2b724f62 tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] [instance: 7b18289e-137f-467c-96ec-cc6179f93e17] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:59:34.522125 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-51ea7c50-1e3f-46ba-bdaf-046e2b724f62 tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:59:34.522572 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-51ea7c50-1e3f-46ba-bdaf-046e2b724f62 tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:59:34.523456 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-51ea7c50-1e3f-46ba-bdaf-046e2b724f62 tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:59:34.523847 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-51ea7c50-1e3f-46ba-bdaf-046e2b724f62 tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:59:34.681911 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-51ea7c50-1e3f-46ba-bdaf-046e2b724f62 tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a4b471d14044069a5969e8bc6ca4f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3429e99ac2a94266b152e053bc6a0006', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:59:34.689423 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-51ea7c50-1e3f-46ba-bdaf-046e2b724f62 tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] 10.222.0.20 "GET /compute/v2.1/servers/7b18289e-137f-467c-96ec-cc6179f93e17" status: 200 len: 1574 microversion: 2.1 time: 0.179006 Jul 05 20:59:34.689990 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 308/606] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:59:34 2022] GET /compute/v2.1/servers/7b18289e-137f-467c-96ec-cc6179f93e17 => generated 1574 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 20:59:35.706770 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-e9143832-c424-45c1-bdf1-3da1806fa2d2 tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:59:35.707322 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-e9143832-c424-45c1-bdf1-3da1806fa2d2 tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] [instance: 7b18289e-137f-467c-96ec-cc6179f93e17] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:59:35.713415 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-e9143832-c424-45c1-bdf1-3da1806fa2d2 tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:59:35.713854 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-e9143832-c424-45c1-bdf1-3da1806fa2d2 tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:59:35.714599 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-e9143832-c424-45c1-bdf1-3da1806fa2d2 tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:59:35.715028 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-e9143832-c424-45c1-bdf1-3da1806fa2d2 tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:59:35.756449 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-e7c8d873-1874-4799-a2a3-9d5c765cc6ce tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 20:59:35.757032 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-e7c8d873-1874-4799-a2a3-9d5c765cc6ce tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] [instance: 1b6eabe8-54b0-43cf-94ff-9d4abc8168db] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:59:35.766080 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-e7c8d873-1874-4799-a2a3-9d5c765cc6ce tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:59:35.766248 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-e7c8d873-1874-4799-a2a3-9d5c765cc6ce tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:59:35.767042 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-e7c8d873-1874-4799-a2a3-9d5c765cc6ce tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:59:35.767476 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-e7c8d873-1874-4799-a2a3-9d5c765cc6ce tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:59:35.792331 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.objects.instance [None req-e7c8d873-1874-4799-a2a3-9d5c765cc6ce tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lazy-loading 'flavor' on Instance uuid 1b6eabe8-54b0-43cf-94ff-9d4abc8168db {{(pid=117628) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 05 20:59:35.865995 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-e9143832-c424-45c1-bdf1-3da1806fa2d2 tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a4b471d14044069a5969e8bc6ca4f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3429e99ac2a94266b152e053bc6a0006', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:59:35.874004 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-e9143832-c424-45c1-bdf1-3da1806fa2d2 tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] 10.222.0.20 "GET /compute/v2.1/servers/7b18289e-137f-467c-96ec-cc6179f93e17" status: 200 len: 1574 microversion: 2.1 time: 0.171309 Jul 05 20:59:35.875352 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 299/607] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:59:35 2022] GET /compute/v2.1/servers/7b18289e-137f-467c-96ec-cc6179f93e17 => generated 1574 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 20:59:36.055523 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-e7c8d873-1874-4799-a2a3-9d5c765cc6ce tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] 10.222.0.20 "POST /compute/v2.1/servers/1b6eabe8-54b0-43cf-94ff-9d4abc8168db/action" status: 202 len: 0 microversion: 2.20 time: 0.302255 Jul 05 20:59:36.056144 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 309/608] 10.222.0.20 () {62 vars in 1318 bytes} [Tue Jul 5 20:59:35 2022] POST /compute/v2.1/servers/1b6eabe8-54b0-43cf-94ff-9d4abc8168db/action => generated 0 bytes in 304 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jul 05 20:59:36.064295 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-56796f57-a740-4608-8362-f963504cb97f tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:59:36.064954 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-56796f57-a740-4608-8362-f963504cb97f tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] [instance: 1b6eabe8-54b0-43cf-94ff-9d4abc8168db] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:59:36.071618 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-56796f57-a740-4608-8362-f963504cb97f tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:59:36.072210 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-56796f57-a740-4608-8362-f963504cb97f tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:59:36.073002 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-56796f57-a740-4608-8362-f963504cb97f tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:59:36.073441 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-56796f57-a740-4608-8362-f963504cb97f tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:59:36.201844 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-56796f57-a740-4608-8362-f963504cb97f tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:59:36.209736 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-56796f57-a740-4608-8362-f963504cb97f tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:59:36.212371 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-56796f57-a740-4608-8362-f963504cb97f tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:59:36.213554 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-56796f57-a740-4608-8362-f963504cb97f tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] 10.222.0.20 "GET /compute/v2.1/servers/1b6eabe8-54b0-43cf-94ff-9d4abc8168db" status: 200 len: 1719 microversion: 2.20 time: 0.153273 Jul 05 20:59:36.214114 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 300/609] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 5 20:59:36 2022] GET /compute/v2.1/servers/1b6eabe8-54b0-43cf-94ff-9d4abc8168db => generated 1719 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 20:59:36.892072 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-1febbaa9-2420-4607-ba17-d2f2e0f9bdf4 tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:59:36.892757 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-1febbaa9-2420-4607-ba17-d2f2e0f9bdf4 tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] [instance: 7b18289e-137f-467c-96ec-cc6179f93e17] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:59:36.900530 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-1febbaa9-2420-4607-ba17-d2f2e0f9bdf4 tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:59:36.900990 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-1febbaa9-2420-4607-ba17-d2f2e0f9bdf4 tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:59:36.901758 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-1febbaa9-2420-4607-ba17-d2f2e0f9bdf4 tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:59:36.902171 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-1febbaa9-2420-4607-ba17-d2f2e0f9bdf4 tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:59:37.035817 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-1febbaa9-2420-4607-ba17-d2f2e0f9bdf4 tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a4b471d14044069a5969e8bc6ca4f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3429e99ac2a94266b152e053bc6a0006', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:59:37.043782 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-1febbaa9-2420-4607-ba17-d2f2e0f9bdf4 tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] 10.222.0.20 "GET /compute/v2.1/servers/7b18289e-137f-467c-96ec-cc6179f93e17" status: 200 len: 1574 microversion: 2.1 time: 0.156487 Jul 05 20:59:37.044341 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 310/610] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:59:36 2022] GET /compute/v2.1/servers/7b18289e-137f-467c-96ec-cc6179f93e17 => generated 1574 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 20:59:37.232954 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-4763c109-5a0d-4475-a760-4f8e08b6eab4 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:59:37.233557 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-4763c109-5a0d-4475-a760-4f8e08b6eab4 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] [instance: 1b6eabe8-54b0-43cf-94ff-9d4abc8168db] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:59:37.239991 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-4763c109-5a0d-4475-a760-4f8e08b6eab4 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:59:37.240434 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-4763c109-5a0d-4475-a760-4f8e08b6eab4 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:59:37.241203 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-4763c109-5a0d-4475-a760-4f8e08b6eab4 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:59:37.241631 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-4763c109-5a0d-4475-a760-4f8e08b6eab4 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:59:37.374054 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-4763c109-5a0d-4475-a760-4f8e08b6eab4 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:59:37.381952 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-4763c109-5a0d-4475-a760-4f8e08b6eab4 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:59:37.384108 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-4763c109-5a0d-4475-a760-4f8e08b6eab4 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:59:37.385351 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-4763c109-5a0d-4475-a760-4f8e08b6eab4 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] 10.222.0.20 "GET /compute/v2.1/servers/1b6eabe8-54b0-43cf-94ff-9d4abc8168db" status: 200 len: 1719 microversion: 2.20 time: 0.156238 Jul 05 20:59:37.385910 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 301/611] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 5 20:59:37 2022] GET /compute/v2.1/servers/1b6eabe8-54b0-43cf-94ff-9d4abc8168db => generated 1719 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 20:59:38.061179 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-ac7fbd50-9288-4594-8e60-a9a2a8852754 tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:59:38.061786 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-ac7fbd50-9288-4594-8e60-a9a2a8852754 tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] [instance: 7b18289e-137f-467c-96ec-cc6179f93e17] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:59:38.068251 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-ac7fbd50-9288-4594-8e60-a9a2a8852754 tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:59:38.068711 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-ac7fbd50-9288-4594-8e60-a9a2a8852754 tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:59:38.069493 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-ac7fbd50-9288-4594-8e60-a9a2a8852754 tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:59:38.069920 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-ac7fbd50-9288-4594-8e60-a9a2a8852754 tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:59:38.205095 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-ac7fbd50-9288-4594-8e60-a9a2a8852754 tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a4b471d14044069a5969e8bc6ca4f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3429e99ac2a94266b152e053bc6a0006', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:59:38.213304 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-ac7fbd50-9288-4594-8e60-a9a2a8852754 tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] 10.222.0.20 "GET /compute/v2.1/servers/7b18289e-137f-467c-96ec-cc6179f93e17" status: 200 len: 1574 microversion: 2.1 time: 0.156081 Jul 05 20:59:38.213876 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 311/612] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:59:38 2022] GET /compute/v2.1/servers/7b18289e-137f-467c-96ec-cc6179f93e17 => generated 1574 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 20:59:38.404766 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-724ef879-32eb-4368-b312-1e7d1bcfc544 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:59:38.405321 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-724ef879-32eb-4368-b312-1e7d1bcfc544 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] [instance: 1b6eabe8-54b0-43cf-94ff-9d4abc8168db] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:59:38.411859 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-724ef879-32eb-4368-b312-1e7d1bcfc544 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:59:38.412308 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-724ef879-32eb-4368-b312-1e7d1bcfc544 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:59:38.413100 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-724ef879-32eb-4368-b312-1e7d1bcfc544 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:59:38.413537 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-724ef879-32eb-4368-b312-1e7d1bcfc544 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:59:38.547837 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-724ef879-32eb-4368-b312-1e7d1bcfc544 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:59:38.556314 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-724ef879-32eb-4368-b312-1e7d1bcfc544 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:59:38.557927 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-724ef879-32eb-4368-b312-1e7d1bcfc544 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:59:38.559076 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-724ef879-32eb-4368-b312-1e7d1bcfc544 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] 10.222.0.20 "GET /compute/v2.1/servers/1b6eabe8-54b0-43cf-94ff-9d4abc8168db" status: 200 len: 1719 microversion: 2.20 time: 0.158228 Jul 05 20:59:38.559625 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 302/613] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 5 20:59:38 2022] GET /compute/v2.1/servers/1b6eabe8-54b0-43cf-94ff-9d4abc8168db => generated 1719 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 20:59:39.230782 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-6f03c19e-41cd-49bf-a8b3-6b7e23ca223f tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:59:39.231418 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-6f03c19e-41cd-49bf-a8b3-6b7e23ca223f tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] [instance: 7b18289e-137f-467c-96ec-cc6179f93e17] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:59:39.237820 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-6f03c19e-41cd-49bf-a8b3-6b7e23ca223f tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:59:39.238266 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-6f03c19e-41cd-49bf-a8b3-6b7e23ca223f tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:59:39.239014 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-6f03c19e-41cd-49bf-a8b3-6b7e23ca223f tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:59:39.239442 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-6f03c19e-41cd-49bf-a8b3-6b7e23ca223f tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:59:39.370778 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-6f03c19e-41cd-49bf-a8b3-6b7e23ca223f tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a4b471d14044069a5969e8bc6ca4f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3429e99ac2a94266b152e053bc6a0006', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:59:39.378071 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-6f03c19e-41cd-49bf-a8b3-6b7e23ca223f tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] 10.222.0.20 "GET /compute/v2.1/servers/7b18289e-137f-467c-96ec-cc6179f93e17" status: 200 len: 1574 microversion: 2.1 time: 0.151738 Jul 05 20:59:39.378629 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 312/614] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:59:39 2022] GET /compute/v2.1/servers/7b18289e-137f-467c-96ec-cc6179f93e17 => generated 1574 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 20:59:39.577170 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-39b5c144-d877-4658-9202-2ca8574cc854 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:59:39.577828 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-39b5c144-d877-4658-9202-2ca8574cc854 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] [instance: 1b6eabe8-54b0-43cf-94ff-9d4abc8168db] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:59:39.584458 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-39b5c144-d877-4658-9202-2ca8574cc854 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:59:39.584906 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-39b5c144-d877-4658-9202-2ca8574cc854 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:59:39.586346 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-39b5c144-d877-4658-9202-2ca8574cc854 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:59:39.586782 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-39b5c144-d877-4658-9202-2ca8574cc854 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:59:39.720813 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-39b5c144-d877-4658-9202-2ca8574cc854 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:59:39.729179 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-39b5c144-d877-4658-9202-2ca8574cc854 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:59:39.730678 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-39b5c144-d877-4658-9202-2ca8574cc854 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:59:39.731878 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-39b5c144-d877-4658-9202-2ca8574cc854 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] 10.222.0.20 "GET /compute/v2.1/servers/1b6eabe8-54b0-43cf-94ff-9d4abc8168db" status: 200 len: 1719 microversion: 2.20 time: 0.159013 Jul 05 20:59:39.732426 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 303/615] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 5 20:59:39 2022] GET /compute/v2.1/servers/1b6eabe8-54b0-43cf-94ff-9d4abc8168db => generated 1719 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 20:59:40.394916 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-d5afa20f-ccb7-447c-a6ae-cc068bfae74f tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:59:40.395505 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-d5afa20f-ccb7-447c-a6ae-cc068bfae74f tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] [instance: 7b18289e-137f-467c-96ec-cc6179f93e17] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:59:40.402259 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-d5afa20f-ccb7-447c-a6ae-cc068bfae74f tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:59:40.402700 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-d5afa20f-ccb7-447c-a6ae-cc068bfae74f tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:59:40.403448 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-d5afa20f-ccb7-447c-a6ae-cc068bfae74f tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:59:40.403883 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-d5afa20f-ccb7-447c-a6ae-cc068bfae74f tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:59:40.531682 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-d5afa20f-ccb7-447c-a6ae-cc068bfae74f tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a4b471d14044069a5969e8bc6ca4f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3429e99ac2a94266b152e053bc6a0006', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:59:40.539597 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-d5afa20f-ccb7-447c-a6ae-cc068bfae74f tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] 10.222.0.20 "GET /compute/v2.1/servers/7b18289e-137f-467c-96ec-cc6179f93e17" status: 200 len: 1574 microversion: 2.1 time: 0.148494 Jul 05 20:59:40.540144 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 313/616] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:59:40 2022] GET /compute/v2.1/servers/7b18289e-137f-467c-96ec-cc6179f93e17 => generated 1574 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 20:59:40.750242 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-5dc4aae9-b3be-4f51-8e52-c3be6ad45237 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:59:40.750765 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-5dc4aae9-b3be-4f51-8e52-c3be6ad45237 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] [instance: 1b6eabe8-54b0-43cf-94ff-9d4abc8168db] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:59:40.757524 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-5dc4aae9-b3be-4f51-8e52-c3be6ad45237 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:59:40.758288 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-5dc4aae9-b3be-4f51-8e52-c3be6ad45237 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:59:40.759062 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-5dc4aae9-b3be-4f51-8e52-c3be6ad45237 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:59:40.759502 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-5dc4aae9-b3be-4f51-8e52-c3be6ad45237 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:59:40.888682 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-5dc4aae9-b3be-4f51-8e52-c3be6ad45237 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:59:40.896803 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-5dc4aae9-b3be-4f51-8e52-c3be6ad45237 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:59:40.898898 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-5dc4aae9-b3be-4f51-8e52-c3be6ad45237 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:59:40.900032 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-5dc4aae9-b3be-4f51-8e52-c3be6ad45237 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] 10.222.0.20 "GET /compute/v2.1/servers/1b6eabe8-54b0-43cf-94ff-9d4abc8168db" status: 200 len: 1719 microversion: 2.20 time: 0.153784 Jul 05 20:59:40.900585 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 304/617] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 5 20:59:40 2022] GET /compute/v2.1/servers/1b6eabe8-54b0-43cf-94ff-9d4abc8168db => generated 1719 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 20:59:41.556990 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-4d900dad-3db2-4f01-a0f7-8fd08304bbc0 tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:59:41.557602 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-4d900dad-3db2-4f01-a0f7-8fd08304bbc0 tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] [instance: 7b18289e-137f-467c-96ec-cc6179f93e17] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:59:41.564199 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-4d900dad-3db2-4f01-a0f7-8fd08304bbc0 tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:59:41.564647 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-4d900dad-3db2-4f01-a0f7-8fd08304bbc0 tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:59:41.565432 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-4d900dad-3db2-4f01-a0f7-8fd08304bbc0 tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:59:41.565867 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-4d900dad-3db2-4f01-a0f7-8fd08304bbc0 tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:59:41.694765 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-4d900dad-3db2-4f01-a0f7-8fd08304bbc0 tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a4b471d14044069a5969e8bc6ca4f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3429e99ac2a94266b152e053bc6a0006', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:59:41.703017 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-4d900dad-3db2-4f01-a0f7-8fd08304bbc0 tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] 10.222.0.20 "GET /compute/v2.1/servers/7b18289e-137f-467c-96ec-cc6179f93e17" status: 200 len: 1574 microversion: 2.1 time: 0.150392 Jul 05 20:59:41.703578 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 314/618] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:59:41 2022] GET /compute/v2.1/servers/7b18289e-137f-467c-96ec-cc6179f93e17 => generated 1574 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 20:59:41.918527 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-3a1fd528-8ee2-4033-9c6b-5b1e6469e1c5 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:59:41.919075 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-3a1fd528-8ee2-4033-9c6b-5b1e6469e1c5 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] [instance: 1b6eabe8-54b0-43cf-94ff-9d4abc8168db] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:59:41.925506 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-3a1fd528-8ee2-4033-9c6b-5b1e6469e1c5 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:59:41.925947 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-3a1fd528-8ee2-4033-9c6b-5b1e6469e1c5 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:59:41.926686 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-3a1fd528-8ee2-4033-9c6b-5b1e6469e1c5 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:59:41.927111 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-3a1fd528-8ee2-4033-9c6b-5b1e6469e1c5 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:59:41.942232 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG dbcounter [-] [117627] Writing DB stats nova_cell1:SELECT=100 {{(pid=117627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:59:42.058876 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-3a1fd528-8ee2-4033-9c6b-5b1e6469e1c5 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:59:42.066981 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-3a1fd528-8ee2-4033-9c6b-5b1e6469e1c5 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:59:42.068525 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-3a1fd528-8ee2-4033-9c6b-5b1e6469e1c5 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:59:42.069710 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-3a1fd528-8ee2-4033-9c6b-5b1e6469e1c5 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] 10.222.0.20 "GET /compute/v2.1/servers/1b6eabe8-54b0-43cf-94ff-9d4abc8168db" status: 200 len: 1719 microversion: 2.20 time: 0.155129 Jul 05 20:59:42.070325 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 305/619] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 5 20:59:41 2022] GET /compute/v2.1/servers/1b6eabe8-54b0-43cf-94ff-9d4abc8168db => generated 1719 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 20:59:42.719408 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-f31529b7-edce-46f0-b537-01901e421891 tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:59:42.720028 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-f31529b7-edce-46f0-b537-01901e421891 tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] [instance: 7b18289e-137f-467c-96ec-cc6179f93e17] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:59:42.726434 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-f31529b7-edce-46f0-b537-01901e421891 tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:59:42.727292 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-f31529b7-edce-46f0-b537-01901e421891 tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:59:42.728044 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-f31529b7-edce-46f0-b537-01901e421891 tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:59:42.728474 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-f31529b7-edce-46f0-b537-01901e421891 tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:59:42.860532 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-f31529b7-edce-46f0-b537-01901e421891 tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a4b471d14044069a5969e8bc6ca4f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3429e99ac2a94266b152e053bc6a0006', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:59:42.868046 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-f31529b7-edce-46f0-b537-01901e421891 tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] 10.222.0.20 "GET /compute/v2.1/servers/7b18289e-137f-467c-96ec-cc6179f93e17" status: 200 len: 1574 microversion: 2.1 time: 0.152457 Jul 05 20:59:42.868603 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 315/620] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:59:42 2022] GET /compute/v2.1/servers/7b18289e-137f-467c-96ec-cc6179f93e17 => generated 1574 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 20:59:43.087870 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-08ea0b16-9668-492b-8a7e-0aca79009f74 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:59:43.088591 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-08ea0b16-9668-492b-8a7e-0aca79009f74 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] [instance: 1b6eabe8-54b0-43cf-94ff-9d4abc8168db] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:59:43.095852 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-08ea0b16-9668-492b-8a7e-0aca79009f74 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:59:43.096294 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-08ea0b16-9668-492b-8a7e-0aca79009f74 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:59:43.097087 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-08ea0b16-9668-492b-8a7e-0aca79009f74 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:59:43.097590 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-08ea0b16-9668-492b-8a7e-0aca79009f74 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:59:43.253079 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-08ea0b16-9668-492b-8a7e-0aca79009f74 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:59:43.263483 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-08ea0b16-9668-492b-8a7e-0aca79009f74 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:59:43.265170 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-08ea0b16-9668-492b-8a7e-0aca79009f74 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:59:43.266317 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-08ea0b16-9668-492b-8a7e-0aca79009f74 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] 10.222.0.20 "GET /compute/v2.1/servers/1b6eabe8-54b0-43cf-94ff-9d4abc8168db" status: 200 len: 1719 microversion: 2.20 time: 0.182703 Jul 05 20:59:43.269328 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 306/621] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 5 20:59:43 2022] GET /compute/v2.1/servers/1b6eabe8-54b0-43cf-94ff-9d4abc8168db => generated 1719 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 20:59:43.886190 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-8118f428-0038-4ae4-927e-b344d9d4360a tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:59:43.886791 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-8118f428-0038-4ae4-927e-b344d9d4360a tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] [instance: 7b18289e-137f-467c-96ec-cc6179f93e17] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:59:43.893315 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-8118f428-0038-4ae4-927e-b344d9d4360a tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:59:43.893754 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-8118f428-0038-4ae4-927e-b344d9d4360a tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:59:43.894501 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-8118f428-0038-4ae4-927e-b344d9d4360a tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:59:43.894929 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-8118f428-0038-4ae4-927e-b344d9d4360a tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:59:44.028114 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-8118f428-0038-4ae4-927e-b344d9d4360a tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a4b471d14044069a5969e8bc6ca4f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3429e99ac2a94266b152e053bc6a0006', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:59:44.030412 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG dbcounter [-] [117628] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:59:44.036825 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-8118f428-0038-4ae4-927e-b344d9d4360a tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] 10.222.0.20 "GET /compute/v2.1/servers/7b18289e-137f-467c-96ec-cc6179f93e17" status: 200 len: 1574 microversion: 2.1 time: 0.155073 Jul 05 20:59:44.037413 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 316/622] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:59:43 2022] GET /compute/v2.1/servers/7b18289e-137f-467c-96ec-cc6179f93e17 => generated 1574 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 20:59:44.284868 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-0711d9ee-f530-4ded-b0a1-187498c35c65 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:59:44.285432 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-0711d9ee-f530-4ded-b0a1-187498c35c65 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] [instance: 1b6eabe8-54b0-43cf-94ff-9d4abc8168db] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:59:44.292730 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-0711d9ee-f530-4ded-b0a1-187498c35c65 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:59:44.293628 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-0711d9ee-f530-4ded-b0a1-187498c35c65 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:59:44.293955 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-0711d9ee-f530-4ded-b0a1-187498c35c65 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:59:44.294389 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-0711d9ee-f530-4ded-b0a1-187498c35c65 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:59:44.435795 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-0711d9ee-f530-4ded-b0a1-187498c35c65 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:59:44.443592 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-0711d9ee-f530-4ded-b0a1-187498c35c65 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:59:44.445376 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-0711d9ee-f530-4ded-b0a1-187498c35c65 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:59:44.446301 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-0711d9ee-f530-4ded-b0a1-187498c35c65 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] 10.222.0.20 "GET /compute/v2.1/servers/1b6eabe8-54b0-43cf-94ff-9d4abc8168db" status: 200 len: 1719 microversion: 2.20 time: 0.165455 Jul 05 20:59:44.446848 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 307/623] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 5 20:59:44 2022] GET /compute/v2.1/servers/1b6eabe8-54b0-43cf-94ff-9d4abc8168db => generated 1719 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 20:59:45.054729 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-cabd89c3-c0e0-46af-992d-79891c0bacfd tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:59:45.055336 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-cabd89c3-c0e0-46af-992d-79891c0bacfd tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] [instance: 7b18289e-137f-467c-96ec-cc6179f93e17] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:59:45.062891 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-cabd89c3-c0e0-46af-992d-79891c0bacfd tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:59:45.063430 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-cabd89c3-c0e0-46af-992d-79891c0bacfd tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:59:45.064235 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-cabd89c3-c0e0-46af-992d-79891c0bacfd tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:59:45.064673 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-cabd89c3-c0e0-46af-992d-79891c0bacfd tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:59:45.193599 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-cabd89c3-c0e0-46af-992d-79891c0bacfd tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a4b471d14044069a5969e8bc6ca4f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3429e99ac2a94266b152e053bc6a0006', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:59:45.201720 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-cabd89c3-c0e0-46af-992d-79891c0bacfd tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] 10.222.0.20 "GET /compute/v2.1/servers/7b18289e-137f-467c-96ec-cc6179f93e17" status: 200 len: 1574 microversion: 2.1 time: 0.151063 Jul 05 20:59:45.202277 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 317/624] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:59:45 2022] GET /compute/v2.1/servers/7b18289e-137f-467c-96ec-cc6179f93e17 => generated 1574 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 20:59:45.464507 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-a24ddc6f-db9e-4b79-bbc3-7a6f86a51354 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:59:45.465058 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-a24ddc6f-db9e-4b79-bbc3-7a6f86a51354 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] [instance: 1b6eabe8-54b0-43cf-94ff-9d4abc8168db] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:59:45.471492 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-a24ddc6f-db9e-4b79-bbc3-7a6f86a51354 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:59:45.471937 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-a24ddc6f-db9e-4b79-bbc3-7a6f86a51354 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:59:45.472685 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-a24ddc6f-db9e-4b79-bbc3-7a6f86a51354 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:59:45.473149 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-a24ddc6f-db9e-4b79-bbc3-7a6f86a51354 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:59:45.607063 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-a24ddc6f-db9e-4b79-bbc3-7a6f86a51354 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:59:45.614955 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-a24ddc6f-db9e-4b79-bbc3-7a6f86a51354 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:59:45.617081 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-a24ddc6f-db9e-4b79-bbc3-7a6f86a51354 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:59:45.619034 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-a24ddc6f-db9e-4b79-bbc3-7a6f86a51354 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] 10.222.0.20 "GET /compute/v2.1/servers/1b6eabe8-54b0-43cf-94ff-9d4abc8168db" status: 200 len: 1719 microversion: 2.20 time: 0.158566 Jul 05 20:59:45.619608 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 308/625] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 5 20:59:45 2022] GET /compute/v2.1/servers/1b6eabe8-54b0-43cf-94ff-9d4abc8168db => generated 1719 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 20:59:46.218735 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-9276cd61-dd9b-4455-8960-d886afede6b5 tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:59:46.219365 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-9276cd61-dd9b-4455-8960-d886afede6b5 tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] [instance: 7b18289e-137f-467c-96ec-cc6179f93e17] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:59:46.225680 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-9276cd61-dd9b-4455-8960-d886afede6b5 tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:59:46.226902 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-9276cd61-dd9b-4455-8960-d886afede6b5 tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:59:46.227651 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-9276cd61-dd9b-4455-8960-d886afede6b5 tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:59:46.228079 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-9276cd61-dd9b-4455-8960-d886afede6b5 tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:59:46.357112 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-9276cd61-dd9b-4455-8960-d886afede6b5 tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a4b471d14044069a5969e8bc6ca4f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3429e99ac2a94266b152e053bc6a0006', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:59:46.364753 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-9276cd61-dd9b-4455-8960-d886afede6b5 tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] 10.222.0.20 "GET /compute/v2.1/servers/7b18289e-137f-467c-96ec-cc6179f93e17" status: 200 len: 1574 microversion: 2.1 time: 0.149775 Jul 05 20:59:46.365363 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 318/626] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:59:46 2022] GET /compute/v2.1/servers/7b18289e-137f-467c-96ec-cc6179f93e17 => generated 1574 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 20:59:46.567037 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [req-bf5ae9da-7547-4003-be31-e4c6e9d67997 req-46114bb5-3f9d-4776-b6d3-eca83329e5aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b18289e-137f-467c-96ec-cc6179f93e17", "name": "network-vif-plugged", "status": "completed", "tag": "6b603e35-d2c5-47fc-83a0-12c2780e086f"}]} {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 20:59:46.577067 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [req-bf5ae9da-7547-4003-be31-e4c6e9d67997 req-46114bb5-3f9d-4776-b6d3-eca83329e5aa service nova] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:59:46.577515 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [req-bf5ae9da-7547-4003-be31-e4c6e9d67997 req-46114bb5-3f9d-4776-b6d3-eca83329e5aa service nova] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:59:46.589697 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.compute.server_external_events [req-bf5ae9da-7547-4003-be31-e4c6e9d67997 req-46114bb5-3f9d-4776-b6d3-eca83329e5aa service nova] Creating event network-vif-plugged:6b603e35-d2c5-47fc-83a0-12c2780e086f for instance 7b18289e-137f-467c-96ec-cc6179f93e17 on hv-cinder-79760 Jul 05 20:59:46.594681 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [req-bf5ae9da-7547-4003-be31-e4c6e9d67997 req-46114bb5-3f9d-4776-b6d3-eca83329e5aa service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031387 Jul 05 20:59:46.595421 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 309/627] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 5 20:59:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 20:59:46.637667 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-8e81d28a-e93e-40fc-b99a-6224d08ae931 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:59:46.638219 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-8e81d28a-e93e-40fc-b99a-6224d08ae931 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] [instance: 1b6eabe8-54b0-43cf-94ff-9d4abc8168db] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:59:46.644168 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-8e81d28a-e93e-40fc-b99a-6224d08ae931 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:59:46.644614 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-8e81d28a-e93e-40fc-b99a-6224d08ae931 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:59:46.645398 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-8e81d28a-e93e-40fc-b99a-6224d08ae931 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:59:46.646099 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-8e81d28a-e93e-40fc-b99a-6224d08ae931 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:59:46.785508 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-8e81d28a-e93e-40fc-b99a-6224d08ae931 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:59:46.794081 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-8e81d28a-e93e-40fc-b99a-6224d08ae931 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:59:46.795603 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-8e81d28a-e93e-40fc-b99a-6224d08ae931 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:59:46.796755 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-8e81d28a-e93e-40fc-b99a-6224d08ae931 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] 10.222.0.20 "GET /compute/v2.1/servers/1b6eabe8-54b0-43cf-94ff-9d4abc8168db" status: 200 len: 1719 microversion: 2.20 time: 0.162980 Jul 05 20:59:46.797346 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 319/628] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 5 20:59:46 2022] GET /compute/v2.1/servers/1b6eabe8-54b0-43cf-94ff-9d4abc8168db => generated 1719 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 05 20:59:47.383114 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-b81af0f7-b786-4f1c-9ee5-249617f8377f tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:59:47.383816 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-b81af0f7-b786-4f1c-9ee5-249617f8377f tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] [instance: 7b18289e-137f-467c-96ec-cc6179f93e17] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:59:47.390030 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-b81af0f7-b786-4f1c-9ee5-249617f8377f tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:59:47.390471 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-b81af0f7-b786-4f1c-9ee5-249617f8377f tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:59:47.391233 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-b81af0f7-b786-4f1c-9ee5-249617f8377f tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:59:47.391656 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-b81af0f7-b786-4f1c-9ee5-249617f8377f tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:59:47.536017 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-b81af0f7-b786-4f1c-9ee5-249617f8377f tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a4b471d14044069a5969e8bc6ca4f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3429e99ac2a94266b152e053bc6a0006', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:59:47.543606 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-b81af0f7-b786-4f1c-9ee5-249617f8377f tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] 10.222.0.20 "GET /compute/v2.1/servers/7b18289e-137f-467c-96ec-cc6179f93e17" status: 200 len: 1574 microversion: 2.1 time: 0.165700 Jul 05 20:59:47.544173 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 310/629] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:59:47 2022] GET /compute/v2.1/servers/7b18289e-137f-467c-96ec-cc6179f93e17 => generated 1574 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 20:59:47.980442 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-eadd5917-c9d6-4596-8a31-89bcfb622902 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:59:47.981116 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-eadd5917-c9d6-4596-8a31-89bcfb622902 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] [instance: 1b6eabe8-54b0-43cf-94ff-9d4abc8168db] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:59:47.987139 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-eadd5917-c9d6-4596-8a31-89bcfb622902 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:59:47.987581 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-eadd5917-c9d6-4596-8a31-89bcfb622902 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:59:47.988330 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-eadd5917-c9d6-4596-8a31-89bcfb622902 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:59:47.988761 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-eadd5917-c9d6-4596-8a31-89bcfb622902 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:59:48.115521 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-eadd5917-c9d6-4596-8a31-89bcfb622902 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:59:48.124025 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-eadd5917-c9d6-4596-8a31-89bcfb622902 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:59:48.125554 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-eadd5917-c9d6-4596-8a31-89bcfb622902 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:59:48.126691 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-eadd5917-c9d6-4596-8a31-89bcfb622902 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] 10.222.0.20 "GET /compute/v2.1/servers/1b6eabe8-54b0-43cf-94ff-9d4abc8168db" status: 200 len: 1719 microversion: 2.20 time: 0.315594 Jul 05 20:59:48.127243 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 320/630] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 5 20:59:47 2022] GET /compute/v2.1/servers/1b6eabe8-54b0-43cf-94ff-9d4abc8168db => generated 1719 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 20:59:48.560486 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-04510fc7-ed50-4547-bc18-013c859cf349 tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:59:48.561156 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-04510fc7-ed50-4547-bc18-013c859cf349 tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] [instance: 7b18289e-137f-467c-96ec-cc6179f93e17] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:59:48.567634 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-04510fc7-ed50-4547-bc18-013c859cf349 tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:59:48.568081 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-04510fc7-ed50-4547-bc18-013c859cf349 tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:59:48.568835 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-04510fc7-ed50-4547-bc18-013c859cf349 tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:59:48.569305 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-04510fc7-ed50-4547-bc18-013c859cf349 tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:59:48.701188 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-04510fc7-ed50-4547-bc18-013c859cf349 tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a4b471d14044069a5969e8bc6ca4f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3429e99ac2a94266b152e053bc6a0006', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:59:48.708620 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-04510fc7-ed50-4547-bc18-013c859cf349 tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] 10.222.0.20 "GET /compute/v2.1/servers/7b18289e-137f-467c-96ec-cc6179f93e17" status: 200 len: 1574 microversion: 2.1 time: 0.151978 Jul 05 20:59:48.709220 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 311/631] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:59:48 2022] GET /compute/v2.1/servers/7b18289e-137f-467c-96ec-cc6179f93e17 => generated 1574 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 20:59:49.144858 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-5688695b-f413-4ad9-94c6-90d299b738f4 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:59:49.145734 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-5688695b-f413-4ad9-94c6-90d299b738f4 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] [instance: 1b6eabe8-54b0-43cf-94ff-9d4abc8168db] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:59:49.152861 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-5688695b-f413-4ad9-94c6-90d299b738f4 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:59:49.153341 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-5688695b-f413-4ad9-94c6-90d299b738f4 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:59:49.154093 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-5688695b-f413-4ad9-94c6-90d299b738f4 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:59:49.154524 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-5688695b-f413-4ad9-94c6-90d299b738f4 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:59:49.283969 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-5688695b-f413-4ad9-94c6-90d299b738f4 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:59:49.292351 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-5688695b-f413-4ad9-94c6-90d299b738f4 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:59:49.293868 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-5688695b-f413-4ad9-94c6-90d299b738f4 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:59:49.295071 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-5688695b-f413-4ad9-94c6-90d299b738f4 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] 10.222.0.20 "GET /compute/v2.1/servers/1b6eabe8-54b0-43cf-94ff-9d4abc8168db" status: 200 len: 1719 microversion: 2.20 time: 0.154199 Jul 05 20:59:49.295620 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 321/632] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 5 20:59:49 2022] GET /compute/v2.1/servers/1b6eabe8-54b0-43cf-94ff-9d4abc8168db => generated 1719 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 20:59:49.726787 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-3766bb1c-5d9e-4796-bc0c-751ba578a9dd tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:59:49.727329 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-3766bb1c-5d9e-4796-bc0c-751ba578a9dd tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] [instance: 7b18289e-137f-467c-96ec-cc6179f93e17] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:59:49.733893 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-3766bb1c-5d9e-4796-bc0c-751ba578a9dd tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:59:49.734337 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-3766bb1c-5d9e-4796-bc0c-751ba578a9dd tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:59:49.735080 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-3766bb1c-5d9e-4796-bc0c-751ba578a9dd tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:59:49.735510 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-3766bb1c-5d9e-4796-bc0c-751ba578a9dd tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:59:49.870311 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-3766bb1c-5d9e-4796-bc0c-751ba578a9dd tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a4b471d14044069a5969e8bc6ca4f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3429e99ac2a94266b152e053bc6a0006', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:59:49.877768 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-3766bb1c-5d9e-4796-bc0c-751ba578a9dd tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] 10.222.0.20 "GET /compute/v2.1/servers/7b18289e-137f-467c-96ec-cc6179f93e17" status: 200 len: 1561 microversion: 2.1 time: 0.155528 Jul 05 20:59:49.878324 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 312/633] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:59:49 2022] GET /compute/v2.1/servers/7b18289e-137f-467c-96ec-cc6179f93e17 => generated 1561 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 20:59:50.313328 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-8d5ab88c-c7e6-409c-9cce-7bc13cd65627 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:59:50.314078 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-8d5ab88c-c7e6-409c-9cce-7bc13cd65627 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] [instance: 1b6eabe8-54b0-43cf-94ff-9d4abc8168db] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:59:50.321299 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-8d5ab88c-c7e6-409c-9cce-7bc13cd65627 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:59:50.321750 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-8d5ab88c-c7e6-409c-9cce-7bc13cd65627 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:59:50.322506 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-8d5ab88c-c7e6-409c-9cce-7bc13cd65627 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:59:50.322934 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-8d5ab88c-c7e6-409c-9cce-7bc13cd65627 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:59:50.454548 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-8d5ab88c-c7e6-409c-9cce-7bc13cd65627 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:59:50.462452 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-8d5ab88c-c7e6-409c-9cce-7bc13cd65627 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:59:50.463940 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-8d5ab88c-c7e6-409c-9cce-7bc13cd65627 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:59:50.465116 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-8d5ab88c-c7e6-409c-9cce-7bc13cd65627 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] 10.222.0.20 "GET /compute/v2.1/servers/1b6eabe8-54b0-43cf-94ff-9d4abc8168db" status: 200 len: 1719 microversion: 2.20 time: 0.155622 Jul 05 20:59:50.465676 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 322/634] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 5 20:59:50 2022] GET /compute/v2.1/servers/1b6eabe8-54b0-43cf-94ff-9d4abc8168db => generated 1719 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 20:59:51.483253 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-5cf41bf3-6998-4fef-984b-ddac5c8468ce tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:59:51.483771 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-5cf41bf3-6998-4fef-984b-ddac5c8468ce tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] [instance: 1b6eabe8-54b0-43cf-94ff-9d4abc8168db] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:59:51.490311 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-5cf41bf3-6998-4fef-984b-ddac5c8468ce tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:59:51.490757 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-5cf41bf3-6998-4fef-984b-ddac5c8468ce tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:59:51.491503 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-5cf41bf3-6998-4fef-984b-ddac5c8468ce tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:59:51.491934 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-5cf41bf3-6998-4fef-984b-ddac5c8468ce tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:59:51.619195 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-5cf41bf3-6998-4fef-984b-ddac5c8468ce tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:59:51.627082 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-5cf41bf3-6998-4fef-984b-ddac5c8468ce tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:59:51.628594 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-5cf41bf3-6998-4fef-984b-ddac5c8468ce tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:59:51.629759 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-5cf41bf3-6998-4fef-984b-ddac5c8468ce tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] 10.222.0.20 "GET /compute/v2.1/servers/1b6eabe8-54b0-43cf-94ff-9d4abc8168db" status: 200 len: 1719 microversion: 2.20 time: 0.150561 Jul 05 20:59:51.630303 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 313/635] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 5 20:59:51 2022] GET /compute/v2.1/servers/1b6eabe8-54b0-43cf-94ff-9d4abc8168db => generated 1719 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 20:59:52.647960 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-51d2c7a0-deea-493b-817d-2e349145f8bd tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:59:52.648570 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-51d2c7a0-deea-493b-817d-2e349145f8bd tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] [instance: 1b6eabe8-54b0-43cf-94ff-9d4abc8168db] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:59:52.655164 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-51d2c7a0-deea-493b-817d-2e349145f8bd tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:59:52.655614 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-51d2c7a0-deea-493b-817d-2e349145f8bd tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:59:52.656375 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-51d2c7a0-deea-493b-817d-2e349145f8bd tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:59:52.656809 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-51d2c7a0-deea-493b-817d-2e349145f8bd tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:59:52.784157 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-51d2c7a0-deea-493b-817d-2e349145f8bd tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:59:52.792855 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-51d2c7a0-deea-493b-817d-2e349145f8bd tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:59:52.794388 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-51d2c7a0-deea-493b-817d-2e349145f8bd tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:59:52.795527 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-51d2c7a0-deea-493b-817d-2e349145f8bd tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] 10.222.0.20 "GET /compute/v2.1/servers/1b6eabe8-54b0-43cf-94ff-9d4abc8168db" status: 200 len: 1719 microversion: 2.20 time: 0.151858 Jul 05 20:59:52.796074 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 323/636] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 5 20:59:52 2022] GET /compute/v2.1/servers/1b6eabe8-54b0-43cf-94ff-9d4abc8168db => generated 1719 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 20:59:53.814103 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-b0ef865a-2e20-4047-bf53-48f0d08830d5 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:59:53.814706 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-b0ef865a-2e20-4047-bf53-48f0d08830d5 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] [instance: 1b6eabe8-54b0-43cf-94ff-9d4abc8168db] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:59:53.821923 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-b0ef865a-2e20-4047-bf53-48f0d08830d5 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:59:53.822371 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-b0ef865a-2e20-4047-bf53-48f0d08830d5 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:59:53.823125 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-b0ef865a-2e20-4047-bf53-48f0d08830d5 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:59:53.823564 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-b0ef865a-2e20-4047-bf53-48f0d08830d5 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:59:53.953173 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-b0ef865a-2e20-4047-bf53-48f0d08830d5 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:59:53.961695 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-b0ef865a-2e20-4047-bf53-48f0d08830d5 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:59:53.963199 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-b0ef865a-2e20-4047-bf53-48f0d08830d5 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:59:53.964348 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-b0ef865a-2e20-4047-bf53-48f0d08830d5 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] 10.222.0.20 "GET /compute/v2.1/servers/1b6eabe8-54b0-43cf-94ff-9d4abc8168db" status: 200 len: 1740 microversion: 2.20 time: 0.154212 Jul 05 20:59:53.964906 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 314/637] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 5 20:59:53 2022] GET /compute/v2.1/servers/1b6eabe8-54b0-43cf-94ff-9d4abc8168db => generated 1740 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 20:59:54.982833 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-704c0d9f-899e-4ad6-be55-e2fdb1303492 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:59:54.983442 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-704c0d9f-899e-4ad6-be55-e2fdb1303492 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] [instance: 1b6eabe8-54b0-43cf-94ff-9d4abc8168db] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:59:54.989775 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-704c0d9f-899e-4ad6-be55-e2fdb1303492 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:59:54.990222 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-704c0d9f-899e-4ad6-be55-e2fdb1303492 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:59:54.990999 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-704c0d9f-899e-4ad6-be55-e2fdb1303492 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:59:54.991435 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-704c0d9f-899e-4ad6-be55-e2fdb1303492 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:59:55.119087 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-704c0d9f-899e-4ad6-be55-e2fdb1303492 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:59:55.126991 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-704c0d9f-899e-4ad6-be55-e2fdb1303492 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:59:55.128477 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-704c0d9f-899e-4ad6-be55-e2fdb1303492 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:59:55.129647 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-704c0d9f-899e-4ad6-be55-e2fdb1303492 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] 10.222.0.20 "GET /compute/v2.1/servers/1b6eabe8-54b0-43cf-94ff-9d4abc8168db" status: 200 len: 1740 microversion: 2.20 time: 0.150770 Jul 05 20:59:55.130198 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 324/638] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 5 20:59:54 2022] GET /compute/v2.1/servers/1b6eabe8-54b0-43cf-94ff-9d4abc8168db => generated 1740 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 20:59:56.149626 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-41a094f9-4556-4153-8549-ad3f1c507cda tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:59:56.150430 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-41a094f9-4556-4153-8549-ad3f1c507cda tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] [instance: 1b6eabe8-54b0-43cf-94ff-9d4abc8168db] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:59:56.158193 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-41a094f9-4556-4153-8549-ad3f1c507cda tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:59:56.158643 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-41a094f9-4556-4153-8549-ad3f1c507cda tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:59:56.159423 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-41a094f9-4556-4153-8549-ad3f1c507cda tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:59:56.159890 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-41a094f9-4556-4153-8549-ad3f1c507cda tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:59:56.327180 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-41a094f9-4556-4153-8549-ad3f1c507cda tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:59:56.336158 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-41a094f9-4556-4153-8549-ad3f1c507cda tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:59:56.339220 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-41a094f9-4556-4153-8549-ad3f1c507cda tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:59:56.340468 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-41a094f9-4556-4153-8549-ad3f1c507cda tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] 10.222.0.20 "GET /compute/v2.1/servers/1b6eabe8-54b0-43cf-94ff-9d4abc8168db" status: 200 len: 1735 microversion: 2.20 time: 0.196628 Jul 05 20:59:56.341049 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 315/639] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 5 20:59:56 2022] GET /compute/v2.1/servers/1b6eabe8-54b0-43cf-94ff-9d4abc8168db => generated 1735 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 05 20:59:57.359003 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-5a509d62-1f38-4dba-a137-7b7816b6cbed tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:59:57.360010 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-5a509d62-1f38-4dba-a137-7b7816b6cbed tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] [instance: 1b6eabe8-54b0-43cf-94ff-9d4abc8168db] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:59:57.362643 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG dbcounter [-] [117628] Writing DB stats nova_api:SELECT=50 {{(pid=117628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:59:57.368815 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-5a509d62-1f38-4dba-a137-7b7816b6cbed tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:59:57.369520 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-5a509d62-1f38-4dba-a137-7b7816b6cbed tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:59:57.370856 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-5a509d62-1f38-4dba-a137-7b7816b6cbed tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:59:57.371304 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-5a509d62-1f38-4dba-a137-7b7816b6cbed tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:59:57.516889 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-5a509d62-1f38-4dba-a137-7b7816b6cbed tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:59:57.528371 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-5a509d62-1f38-4dba-a137-7b7816b6cbed tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:59:57.531110 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-5a509d62-1f38-4dba-a137-7b7816b6cbed tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:59:57.532924 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-5a509d62-1f38-4dba-a137-7b7816b6cbed tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] 10.222.0.20 "GET /compute/v2.1/servers/1b6eabe8-54b0-43cf-94ff-9d4abc8168db" status: 200 len: 1735 microversion: 2.20 time: 0.177417 Jul 05 20:59:57.533523 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 325/640] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 5 20:59:57 2022] GET /compute/v2.1/servers/1b6eabe8-54b0-43cf-94ff-9d4abc8168db => generated 1735 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 20:59:58.551768 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-c310d100-9c2b-4539-8595-b1299aed0c45 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:59:58.552565 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-c310d100-9c2b-4539-8595-b1299aed0c45 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] [instance: 1b6eabe8-54b0-43cf-94ff-9d4abc8168db] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:59:58.555258 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG dbcounter [-] [117627] Writing DB stats nova_api:SELECT=46 {{(pid=117627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:59:58.561187 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-c310d100-9c2b-4539-8595-b1299aed0c45 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:59:58.561845 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-c310d100-9c2b-4539-8595-b1299aed0c45 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:59:58.562909 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-c310d100-9c2b-4539-8595-b1299aed0c45 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:59:58.563351 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-c310d100-9c2b-4539-8595-b1299aed0c45 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:59:58.705939 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-c310d100-9c2b-4539-8595-b1299aed0c45 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:59:58.714546 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-c310d100-9c2b-4539-8595-b1299aed0c45 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:59:58.716082 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-c310d100-9c2b-4539-8595-b1299aed0c45 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:59:58.717743 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-c310d100-9c2b-4539-8595-b1299aed0c45 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] 10.222.0.20 "GET /compute/v2.1/servers/1b6eabe8-54b0-43cf-94ff-9d4abc8168db" status: 200 len: 1735 microversion: 2.20 time: 0.169770 Jul 05 20:59:58.740464 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 316/641] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 5 20:59:58 2022] GET /compute/v2.1/servers/1b6eabe8-54b0-43cf-94ff-9d4abc8168db => generated 1735 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 20:59:59.232156 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [req-4050cd1a-9a8a-4329-8f9f-468cd989a7ca req-81c18cfb-5491-4dd1-8c7c-ceb252c14c9b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b6eabe8-54b0-43cf-94ff-9d4abc8168db", "name": "network-vif-plugged", "status": "completed", "tag": "15ebde2f-b2f2-42b3-a2d3-10634ee149d4"}]} {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 20:59:59.242156 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [req-4050cd1a-9a8a-4329-8f9f-468cd989a7ca req-81c18cfb-5491-4dd1-8c7c-ceb252c14c9b service nova] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:59:59.242875 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [req-4050cd1a-9a8a-4329-8f9f-468cd989a7ca req-81c18cfb-5491-4dd1-8c7c-ceb252c14c9b service nova] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:59:59.259253 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.compute.server_external_events [req-4050cd1a-9a8a-4329-8f9f-468cd989a7ca req-81c18cfb-5491-4dd1-8c7c-ceb252c14c9b service nova] Creating event network-vif-plugged:15ebde2f-b2f2-42b3-a2d3-10634ee149d4 for instance 1b6eabe8-54b0-43cf-94ff-9d4abc8168db on hv-cinder-79760 Jul 05 20:59:59.264368 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [req-4050cd1a-9a8a-4329-8f9f-468cd989a7ca req-81c18cfb-5491-4dd1-8c7c-ceb252c14c9b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115924 Jul 05 20:59:59.265365 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 326/642] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 5 20:59:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 20:59:59.717178 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-810e965e-6333-4669-a52e-a1ec12900748 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:59:59.717726 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-810e965e-6333-4669-a52e-a1ec12900748 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] [instance: 843b93d3-5217-4c0f-b8a9-a335f24c615a] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:59:59.726720 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-810e965e-6333-4669-a52e-a1ec12900748 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:59:59.727163 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-810e965e-6333-4669-a52e-a1ec12900748 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:59:59.727935 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-810e965e-6333-4669-a52e-a1ec12900748 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:59:59.728363 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-810e965e-6333-4669-a52e-a1ec12900748 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:59:59.745778 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-342324a9-4c89-48f4-b4ef-432a4d304c77 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:59:59.747113 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-342324a9-4c89-48f4-b4ef-432a4d304c77 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] [instance: 1b6eabe8-54b0-43cf-94ff-9d4abc8168db] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:59:59.753385 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-342324a9-4c89-48f4-b4ef-432a4d304c77 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:59:59.753927 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-342324a9-4c89-48f4-b4ef-432a4d304c77 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:59:59.755075 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-342324a9-4c89-48f4-b4ef-432a4d304c77 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:59:59.755584 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-342324a9-4c89-48f4-b4ef-432a4d304c77 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:59:59.764776 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-810e965e-6333-4669-a52e-a1ec12900748 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] [instance: 843b93d3-5217-4c0f-b8a9-a335f24c615a] Going to try to terminate instance {{(pid=117627) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 05 20:59:59.938229 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-810e965e-6333-4669-a52e-a1ec12900748 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] 10.222.0.20 "DELETE /compute/v2.1/servers/843b93d3-5217-4c0f-b8a9-a335f24c615a" status: 204 len: 0 microversion: 2.1 time: 0.224421 Jul 05 20:59:59.942036 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 317/643] 10.222.0.20 () {58 vars in 1238 bytes} [Tue Jul 5 20:59:59 2022] DELETE /compute/v2.1/servers/843b93d3-5217-4c0f-b8a9-a335f24c615a => generated 0 bytes in 226 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 05 20:59:59.955940 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-cf0f3e56-2b34-49b1-a447-ed643fc135cd tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 20:59:59.956654 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-cf0f3e56-2b34-49b1-a447-ed643fc135cd tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] [instance: 843b93d3-5217-4c0f-b8a9-a335f24c615a] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 20:59:59.976888 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-342324a9-4c89-48f4-b4ef-432a4d304c77 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:59:59.981697 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-cf0f3e56-2b34-49b1-a447-ed643fc135cd tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:59:59.982312 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-cf0f3e56-2b34-49b1-a447-ed643fc135cd tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:59:59.983216 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-cf0f3e56-2b34-49b1-a447-ed643fc135cd tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 20:59:59.983779 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-cf0f3e56-2b34-49b1-a447-ed643fc135cd tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 20:59:59.993942 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-342324a9-4c89-48f4-b4ef-432a4d304c77 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 20:59:59.998380 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-342324a9-4c89-48f4-b4ef-432a4d304c77 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 21:00:00.002261 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-342324a9-4c89-48f4-b4ef-432a4d304c77 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] 10.222.0.20 "GET /compute/v2.1/servers/1b6eabe8-54b0-43cf-94ff-9d4abc8168db" status: 200 len: 1735 microversion: 2.20 time: 0.263947 Jul 05 21:00:00.003054 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 327/644] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 5 20:59:59 2022] GET /compute/v2.1/servers/1b6eabe8-54b0-43cf-94ff-9d4abc8168db => generated 1735 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 21:00:00.139597 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-cf0f3e56-2b34-49b1-a447-ed643fc135cd tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '261feb03a8ff459b8874232bec05034f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9a3d56f8b84eb2a057425afbf79079', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 21:00:00.147991 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-cf0f3e56-2b34-49b1-a447-ed643fc135cd tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] 10.222.0.20 "GET /compute/v2.1/servers/843b93d3-5217-4c0f-b8a9-a335f24c615a" status: 200 len: 1576 microversion: 2.1 time: 0.201805 Jul 05 21:00:00.152970 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 318/645] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 20:59:59 2022] GET /compute/v2.1/servers/843b93d3-5217-4c0f-b8a9-a335f24c615a => generated 1576 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 21:00:01.021725 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-675687e3-f246-496b-8a02-77178c851127 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 21:00:01.023193 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-675687e3-f246-496b-8a02-77178c851127 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] [instance: 1b6eabe8-54b0-43cf-94ff-9d4abc8168db] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 21:00:01.029236 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-675687e3-f246-496b-8a02-77178c851127 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:00:01.029964 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-675687e3-f246-496b-8a02-77178c851127 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:00:01.030972 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-675687e3-f246-496b-8a02-77178c851127 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:00:01.031874 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-675687e3-f246-496b-8a02-77178c851127 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:00:01.167036 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-5a905437-61cf-4d52-a9a2-a526a65956a1 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 21:00:01.167656 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-5a905437-61cf-4d52-a9a2-a526a65956a1 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] [instance: 843b93d3-5217-4c0f-b8a9-a335f24c615a] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 21:00:01.181446 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-5a905437-61cf-4d52-a9a2-a526a65956a1 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:00:01.181907 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-5a905437-61cf-4d52-a9a2-a526a65956a1 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:00:01.183065 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-5a905437-61cf-4d52-a9a2-a526a65956a1 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:00:01.183622 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-5a905437-61cf-4d52-a9a2-a526a65956a1 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:00:01.241881 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-675687e3-f246-496b-8a02-77178c851127 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 21:00:01.250310 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-675687e3-f246-496b-8a02-77178c851127 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 21:00:01.251859 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-675687e3-f246-496b-8a02-77178c851127 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 21:00:01.266015 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-675687e3-f246-496b-8a02-77178c851127 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] 10.222.0.20 "GET /compute/v2.1/servers/1b6eabe8-54b0-43cf-94ff-9d4abc8168db" status: 200 len: 1735 microversion: 2.20 time: 0.235874 Jul 05 21:00:01.266887 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 328/646] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 5 21:00:01 2022] GET /compute/v2.1/servers/1b6eabe8-54b0-43cf-94ff-9d4abc8168db => generated 1735 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 05 21:00:01.392483 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-5a905437-61cf-4d52-a9a2-a526a65956a1 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '261feb03a8ff459b8874232bec05034f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9a3d56f8b84eb2a057425afbf79079', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 21:00:01.401549 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-5a905437-61cf-4d52-a9a2-a526a65956a1 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] 10.222.0.20 "GET /compute/v2.1/servers/843b93d3-5217-4c0f-b8a9-a335f24c615a" status: 200 len: 1576 microversion: 2.1 time: 0.239696 Jul 05 21:00:01.412149 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 319/647] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 21:00:01 2022] GET /compute/v2.1/servers/843b93d3-5217-4c0f-b8a9-a335f24c615a => generated 1576 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 21:00:02.286769 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-06299265-abf9-408e-9e9f-7951771f81f5 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 21:00:02.287397 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-06299265-abf9-408e-9e9f-7951771f81f5 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] [instance: 1b6eabe8-54b0-43cf-94ff-9d4abc8168db] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 21:00:02.302164 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-06299265-abf9-408e-9e9f-7951771f81f5 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:00:02.302917 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-06299265-abf9-408e-9e9f-7951771f81f5 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:00:02.303875 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-06299265-abf9-408e-9e9f-7951771f81f5 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:00:02.304841 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-06299265-abf9-408e-9e9f-7951771f81f5 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:00:02.421034 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-ea200dc9-0c2b-48c7-bdaa-338cbe4f8158 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 21:00:02.421649 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-ea200dc9-0c2b-48c7-bdaa-338cbe4f8158 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] [instance: 843b93d3-5217-4c0f-b8a9-a335f24c615a] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 21:00:02.440885 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-ea200dc9-0c2b-48c7-bdaa-338cbe4f8158 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:00:02.441365 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-ea200dc9-0c2b-48c7-bdaa-338cbe4f8158 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:00:02.442143 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-ea200dc9-0c2b-48c7-bdaa-338cbe4f8158 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:00:02.442616 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-ea200dc9-0c2b-48c7-bdaa-338cbe4f8158 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:00:02.586984 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-06299265-abf9-408e-9e9f-7951771f81f5 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 21:00:02.600554 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-06299265-abf9-408e-9e9f-7951771f81f5 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 21:00:02.602700 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-06299265-abf9-408e-9e9f-7951771f81f5 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 21:00:02.604129 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-06299265-abf9-408e-9e9f-7951771f81f5 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] 10.222.0.20 "GET /compute/v2.1/servers/1b6eabe8-54b0-43cf-94ff-9d4abc8168db" status: 200 len: 1735 microversion: 2.20 time: 0.321452 Jul 05 21:00:02.623541 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 329/648] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 5 21:00:02 2022] GET /compute/v2.1/servers/1b6eabe8-54b0-43cf-94ff-9d4abc8168db => generated 1735 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 21:00:02.736511 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-ea200dc9-0c2b-48c7-bdaa-338cbe4f8158 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '261feb03a8ff459b8874232bec05034f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9a3d56f8b84eb2a057425afbf79079', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 21:00:02.744852 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-ea200dc9-0c2b-48c7-bdaa-338cbe4f8158 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] 10.222.0.20 "GET /compute/v2.1/servers/843b93d3-5217-4c0f-b8a9-a335f24c615a" status: 200 len: 1576 microversion: 2.1 time: 0.329752 Jul 05 21:00:02.746115 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 320/649] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 21:00:02 2022] GET /compute/v2.1/servers/843b93d3-5217-4c0f-b8a9-a335f24c615a => generated 1576 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 21:00:03.328648 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [req-82722aaf-7ba5-4d7d-90f2-08bf458b69f6 req-c8cccdd0-6ddf-4a11-8a17-f0bdd3d12dff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "843b93d3-5217-4c0f-b8a9-a335f24c615a", "name": "network-vif-deleted", "tag": "9848df20-e5cf-4e95-93e1-1419520fd1b9"}]} {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 21:00:03.347281 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [req-82722aaf-7ba5-4d7d-90f2-08bf458b69f6 req-c8cccdd0-6ddf-4a11-8a17-f0bdd3d12dff service nova] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:00:03.349409 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [req-82722aaf-7ba5-4d7d-90f2-08bf458b69f6 req-c8cccdd0-6ddf-4a11-8a17-f0bdd3d12dff service nova] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:00:03.368669 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.compute.server_external_events [req-82722aaf-7ba5-4d7d-90f2-08bf458b69f6 req-c8cccdd0-6ddf-4a11-8a17-f0bdd3d12dff service nova] Creating event network-vif-deleted:9848df20-e5cf-4e95-93e1-1419520fd1b9 for instance 843b93d3-5217-4c0f-b8a9-a335f24c615a on hv-cinder-79760 Jul 05 21:00:03.375734 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [req-82722aaf-7ba5-4d7d-90f2-08bf458b69f6 req-c8cccdd0-6ddf-4a11-8a17-f0bdd3d12dff service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.147270 Jul 05 21:00:03.377469 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 330/650] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 5 21:00:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 21:00:03.623187 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-ea1d6058-e3b8-4d1f-9392-3baffc31550a tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 21:00:03.624575 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-ea1d6058-e3b8-4d1f-9392-3baffc31550a tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] [instance: 1b6eabe8-54b0-43cf-94ff-9d4abc8168db] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 21:00:03.635201 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-ea1d6058-e3b8-4d1f-9392-3baffc31550a tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:00:03.637597 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-ea1d6058-e3b8-4d1f-9392-3baffc31550a tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:00:03.638719 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-ea1d6058-e3b8-4d1f-9392-3baffc31550a tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:00:03.639306 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-ea1d6058-e3b8-4d1f-9392-3baffc31550a tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:00:03.647914 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG dbcounter [-] [117627] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:00:03.771482 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-7bfa0e66-477c-426d-bfab-88588f875b63 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 21:00:03.772864 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-7bfa0e66-477c-426d-bfab-88588f875b63 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] [instance: 843b93d3-5217-4c0f-b8a9-a335f24c615a] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 21:00:03.786250 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-7bfa0e66-477c-426d-bfab-88588f875b63 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:00:03.786847 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-7bfa0e66-477c-426d-bfab-88588f875b63 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:00:03.788317 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-7bfa0e66-477c-426d-bfab-88588f875b63 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:00:03.789007 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-7bfa0e66-477c-426d-bfab-88588f875b63 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:00:03.842741 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-7bfa0e66-477c-426d-bfab-88588f875b63 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:00:03.843591 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-7bfa0e66-477c-426d-bfab-88588f875b63 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:00:03.844510 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.objects.instance [None req-7bfa0e66-477c-426d-bfab-88588f875b63 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lazy-loading 'fault' on Instance uuid 843b93d3-5217-4c0f-b8a9-a335f24c615a {{(pid=117628) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 05 21:00:03.885313 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-ea1d6058-e3b8-4d1f-9392-3baffc31550a tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 21:00:03.900489 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-ea1d6058-e3b8-4d1f-9392-3baffc31550a tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 21:00:03.903971 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-ea1d6058-e3b8-4d1f-9392-3baffc31550a tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 21:00:03.905381 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-ea1d6058-e3b8-4d1f-9392-3baffc31550a tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] 10.222.0.20 "GET /compute/v2.1/servers/1b6eabe8-54b0-43cf-94ff-9d4abc8168db" status: 200 len: 1735 microversion: 2.20 time: 0.286250 Jul 05 21:00:03.906414 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 321/651] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 5 21:00:03 2022] GET /compute/v2.1/servers/1b6eabe8-54b0-43cf-94ff-9d4abc8168db => generated 1735 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 21:00:03.932071 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-7bfa0e66-477c-426d-bfab-88588f875b63 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '261feb03a8ff459b8874232bec05034f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9a3d56f8b84eb2a057425afbf79079', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 21:00:03.941994 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-7bfa0e66-477c-426d-bfab-88588f875b63 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] 10.222.0.20 "GET /compute/v2.1/servers/843b93d3-5217-4c0f-b8a9-a335f24c615a" status: 200 len: 1230 microversion: 2.1 time: 0.183141 Jul 05 21:00:03.956837 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 331/652] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 21:00:03 2022] GET /compute/v2.1/servers/843b93d3-5217-4c0f-b8a9-a335f24c615a => generated 1230 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 21:00:04.929627 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-ad18f357-b130-47c1-815c-ae8ea01a9895 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 21:00:04.930260 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-ad18f357-b130-47c1-815c-ae8ea01a9895 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] [instance: 1b6eabe8-54b0-43cf-94ff-9d4abc8168db] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 21:00:04.939109 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-ad18f357-b130-47c1-815c-ae8ea01a9895 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:00:04.939572 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-ad18f357-b130-47c1-815c-ae8ea01a9895 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:00:04.940344 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-ad18f357-b130-47c1-815c-ae8ea01a9895 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:00:04.945902 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-ad18f357-b130-47c1-815c-ae8ea01a9895 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:00:04.965676 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-63552586-aa74-435d-8c33-4bca9e7feb6c tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 21:00:04.966280 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-63552586-aa74-435d-8c33-4bca9e7feb6c tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] [instance: 843b93d3-5217-4c0f-b8a9-a335f24c615a] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 21:00:04.980396 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-63552586-aa74-435d-8c33-4bca9e7feb6c tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:00:04.980855 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-63552586-aa74-435d-8c33-4bca9e7feb6c tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:00:04.981827 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-63552586-aa74-435d-8c33-4bca9e7feb6c tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:00:04.982251 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-63552586-aa74-435d-8c33-4bca9e7feb6c tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:00:05.007706 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.wsgi [None req-63552586-aa74-435d-8c33-4bca9e7feb6c tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] HTTP exception thrown: Instance 843b93d3-5217-4c0f-b8a9-a335f24c615a could not be found. Jul 05 21:00:05.009956 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-63552586-aa74-435d-8c33-4bca9e7feb6c tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Request method failure captured: Jul 05 21:00:05.009956 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: request: GET /compute/v2.1/servers/843b93d3-5217-4c0f-b8a9-a335f24c615a HTTP/1.1 Jul 05 21:00:05.009956 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: Accept: application/json Jul 05 21:00:05.009956 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: Accept-Encoding: identity Jul 05 21:00:05.009956 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: Connection: close Jul 05 21:00:05.009956 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: Content-Length: 0 Jul 05 21:00:05.009956 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: Content-Type: application/json Jul 05 21:00:05.009956 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: Host: 10.222.0.20 Jul 05 21:00:05.009956 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: Openstack-System-Scope: None Jul 05 21:00:05.009956 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: User-Agent: python-urllib3/1.26.9 Jul 05 21:00:05.009956 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Auth-Token: gAAAAABixKV-GcDC4lUNiJdOqEVVMAbZnkn9E9HC7T9UddyKTAtPpXm0wmmCXq37cCErruEoTYPrxR2enkx0RyOZqfGtr6EG-anGncOUaEEqbpXW3Rg6XJ-ohCrIXyT7Tt7TbgrLJi1wtWjTZD0cChjlb5fxi6qKGTwb9N8HmmJDYhtyE3zq-bo Jul 05 21:00:05.009956 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Domain-Id: None Jul 05 21:00:05.009956 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Domain-Name: None Jul 05 21:00:05.009956 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Identity-Status: Confirmed Jul 05 21:00:05.009956 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Is-Admin-Project: True Jul 05 21:00:05.009956 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Project-Domain-Id: default Jul 05 21:00:05.009956 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Project-Domain-Name: Default Jul 05 21:00:05.009956 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Project-Id: 6c9a3d56f8b84eb2a057425afbf79079 Jul 05 21:00:05.009956 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Project-Name: tempest-TestVolumeBootPattern-1281668618 Jul 05 21:00:05.009956 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Role: member,reader Jul 05 21:00:05.009956 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Roles: member,reader Jul 05 21:00:05.011692 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6c9a3d56f8b84eb2a057425afbf79079"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6c9a3d56f8b84eb2a057425afbf79079"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6c9a3d56f8b84eb2a057425afbf79079"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6c9a3d56f8b84eb2a057425afbf79079"}]}] Jul 05 21:00:05.011692 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Tenant: tempest-TestVolumeBootPattern-1281668618 Jul 05 21:00:05.011692 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Tenant-Id: 6c9a3d56f8b84eb2a057425afbf79079 Jul 05 21:00:05.011692 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Tenant-Name: tempest-TestVolumeBootPattern-1281668618 Jul 05 21:00:05.011692 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-User: tempest-TestVolumeBootPattern-1281668618-project Jul 05 21:00:05.011692 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-User-Domain-Id: default Jul 05 21:00:05.011692 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-User-Domain-Name: Default Jul 05 21:00:05.011692 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-User-Id: 261feb03a8ff459b8874232bec05034f Jul 05 21:00:05.011692 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-User-Name: tempest-TestVolumeBootPattern-1281668618-project Jul 05 21:00:05.011692 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: method: > Jul 05 21:00:05.011692 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: exception: Instance 843b93d3-5217-4c0f-b8a9-a335f24c615a could not be found. Jul 05 21:00:05.011692 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: action_args: {'id': '843b93d3-5217-4c0f-b8a9-a335f24c615a'} Jul 05 21:00:05.012686 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 05 21:00:05.012686 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 21:00:05.012686 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 05 21:00:05.012686 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 05 21:00:05.012686 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 05 21:00:05.012686 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 05 21:00:05.012686 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 05 21:00:05.012686 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 05 21:00:05.012686 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 05 21:00:05.012686 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 05 21:00:05.012686 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 843b93d3-5217-4c0f-b8a9-a335f24c615a could not be found. Jul 05 21:00:05.012686 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi Jul 05 21:00:05.012686 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 21:00:05.012686 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi Jul 05 21:00:05.012686 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 21:00:05.012686 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 21:00:05.012686 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 21:00:05.012686 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 05 21:00:05.012686 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 05 21:00:05.012686 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 05 21:00:05.014229 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 05 21:00:05.014229 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 05 21:00:05.014229 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 05 21:00:05.014229 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 05 21:00:05.014229 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 05 21:00:05.014229 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 05 21:00:05.014229 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 05 21:00:05.014229 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 843b93d3-5217-4c0f-b8a9-a335f24c615a could not be found. Jul 05 21:00:05.014229 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi Jul 05 21:00:05.014229 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 21:00:05.014229 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi Jul 05 21:00:05.014229 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 21:00:05.014229 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 21:00:05.014229 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 21:00:05.014229 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 05 21:00:05.014229 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 05 21:00:05.014229 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 843b93d3-5217-4c0f-b8a9-a335f24c615a could not be found. Jul 05 21:00:05.014229 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi Jul 05 21:00:05.017522 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-63552586-aa74-435d-8c33-4bca9e7feb6c tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Returning 404 to user: Instance 843b93d3-5217-4c0f-b8a9-a335f24c615a could not be found. {{(pid=117628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 05 21:00:05.019025 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-63552586-aa74-435d-8c33-4bca9e7feb6c tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] 10.222.0.20 "GET /compute/v2.1/servers/843b93d3-5217-4c0f-b8a9-a335f24c615a" status: 404 len: 111 microversion: 2.1 time: 0.058618 Jul 05 21:00:05.019603 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 332/653] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 21:00:04 2022] GET /compute/v2.1/servers/843b93d3-5217-4c0f-b8a9-a335f24c615a => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 05 21:00:05.138143 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-ad18f357-b130-47c1-815c-ae8ea01a9895 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 21:00:05.151394 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-ad18f357-b130-47c1-815c-ae8ea01a9895 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 21:00:05.154336 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-ad18f357-b130-47c1-815c-ae8ea01a9895 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 21:00:05.155533 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-ad18f357-b130-47c1-815c-ae8ea01a9895 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] 10.222.0.20 "GET /compute/v2.1/servers/1b6eabe8-54b0-43cf-94ff-9d4abc8168db" status: 200 len: 1735 microversion: 2.20 time: 0.230818 Jul 05 21:00:05.156085 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 322/654] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 5 21:00:04 2022] GET /compute/v2.1/servers/1b6eabe8-54b0-43cf-94ff-9d4abc8168db => generated 1735 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 21:00:05.183181 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-d3c2e0bf-8988-477d-8a38-a13a779b1d4d tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-720556159", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-858447728", "security_groups": [{"name": "tempest-secgroup-smoke-1135024658"}], "block_device_mapping_v2": [{"uuid": "a82ed427-9c2e-4767-887b-5206dbadd708", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "cd331159-a19a-44ee-94a4-edd89916e91b"}]}} {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 21:00:05.358459 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.network.neutron [None req-d3c2e0bf-8988-477d-8a38-a13a779b1d4d tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] validate_networks() for [('cd331159-a19a-44ee-94a4-edd89916e91b', None, None, None, None, None)] {{(pid=117628) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 05 21:00:06.176506 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-e729ac5f-dbf0-479e-b7db-7120231f007f tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 21:00:06.177283 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-e729ac5f-dbf0-479e-b7db-7120231f007f tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] [instance: 1b6eabe8-54b0-43cf-94ff-9d4abc8168db] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 21:00:06.188691 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-e729ac5f-dbf0-479e-b7db-7120231f007f tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:00:06.189172 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-e729ac5f-dbf0-479e-b7db-7120231f007f tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:00:06.192645 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-e729ac5f-dbf0-479e-b7db-7120231f007f tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:00:06.194732 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-e729ac5f-dbf0-479e-b7db-7120231f007f tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:00:06.231312 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.virt.hardware [None req-d3c2e0bf-8988-477d-8a38-a13a779b1d4d tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Flavor limits 0:0:0 {{(pid=117628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 05 21:00:06.231878 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.virt.hardware [None req-d3c2e0bf-8988-477d-8a38-a13a779b1d4d tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Image limits 0:0:0 {{(pid=117628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 05 21:00:06.232451 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.virt.hardware [None req-d3c2e0bf-8988-477d-8a38-a13a779b1d4d tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Flavor pref 0:0:0 {{(pid=117628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 05 21:00:06.232973 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.virt.hardware [None req-d3c2e0bf-8988-477d-8a38-a13a779b1d4d tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Image pref 0:0:0 {{(pid=117628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 05 21:00:06.233578 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.virt.hardware [None req-d3c2e0bf-8988-477d-8a38-a13a779b1d4d tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 05 21:00:06.243481 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-d3c2e0bf-8988-477d-8a38-a13a779b1d4d tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:00:06.243912 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-d3c2e0bf-8988-477d-8a38-a13a779b1d4d tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:00:06.244702 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-d3c2e0bf-8988-477d-8a38-a13a779b1d4d tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:00:06.249238 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-d3c2e0bf-8988-477d-8a38-a13a779b1d4d tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:00:06.268499 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.quota [None req-d3c2e0bf-8988-477d-8a38-a13a779b1d4d tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Getting quotas for project 6c9a3d56f8b84eb2a057425afbf79079. Resources: {'cores', 'ram', 'instances'} {{(pid=117628) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 05 21:00:06.274440 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.quota [None req-d3c2e0bf-8988-477d-8a38-a13a779b1d4d tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Getting quotas for user 261feb03a8ff459b8874232bec05034f and project 6c9a3d56f8b84eb2a057425afbf79079. Resources: {'cores', 'ram', 'instances'} {{(pid=117628) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 05 21:00:06.336869 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-d3c2e0bf-8988-477d-8a38-a13a779b1d4d tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Going to run 1 instances... {{(pid=117628) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 05 21:00:06.337186 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-d3c2e0bf-8988-477d-8a38-a13a779b1d4d tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] [instance: eb4c9422-c2c5-4b9a-a86c-a913dfaeda45] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='a82ed427-9c2e-4767-887b-5206dbadd708',volume_size=None,volume_type=None)] {{(pid=117628) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 05 21:00:06.346956 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-e729ac5f-dbf0-479e-b7db-7120231f007f tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 21:00:06.356181 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-e729ac5f-dbf0-479e-b7db-7120231f007f tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 21:00:06.357743 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-e729ac5f-dbf0-479e-b7db-7120231f007f tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 21:00:06.358899 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-e729ac5f-dbf0-479e-b7db-7120231f007f tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] 10.222.0.20 "GET /compute/v2.1/servers/1b6eabe8-54b0-43cf-94ff-9d4abc8168db" status: 200 len: 1717 microversion: 2.20 time: 0.187987 Jul 05 21:00:06.359632 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 323/655] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 5 21:00:06 2022] GET /compute/v2.1/servers/1b6eabe8-54b0-43cf-94ff-9d4abc8168db => generated 1717 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 21:00:06.478319 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-d3c2e0bf-8988-477d-8a38-a13a779b1d4d tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.298825 Jul 05 21:00:06.479296 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 333/656] 10.222.0.20 () {60 vars in 1146 bytes} [Tue Jul 5 21:00:05 2022] POST /compute/v2.1/servers => generated 406 bytes in 1301 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 05 21:00:06.493844 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-26654052-b817-4192-b523-f3956c87885f tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 21:00:06.495740 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-26654052-b817-4192-b523-f3956c87885f tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] [instance: eb4c9422-c2c5-4b9a-a86c-a913dfaeda45] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 21:00:06.574687 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-26654052-b817-4192-b523-f3956c87885f tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '261feb03a8ff459b8874232bec05034f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9a3d56f8b84eb2a057425afbf79079', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 21:00:06.582399 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-26654052-b817-4192-b523-f3956c87885f tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] 10.222.0.20 "GET /compute/v2.1/servers/eb4c9422-c2c5-4b9a-a86c-a913dfaeda45" status: 200 len: 1093 microversion: 2.1 time: 0.094792 Jul 05 21:00:06.582965 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 324/657] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 21:00:06 2022] GET /compute/v2.1/servers/eb4c9422-c2c5-4b9a-a86c-a913dfaeda45 => generated 1093 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 21:00:07.377874 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-ae939bc1-03e4-4d3b-9afc-d1ce0beb0d9e tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 21:00:07.378481 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-ae939bc1-03e4-4d3b-9afc-d1ce0beb0d9e tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] [instance: 1b6eabe8-54b0-43cf-94ff-9d4abc8168db] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 21:00:07.385206 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-ae939bc1-03e4-4d3b-9afc-d1ce0beb0d9e tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:00:07.386021 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-ae939bc1-03e4-4d3b-9afc-d1ce0beb0d9e tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:00:07.386794 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-ae939bc1-03e4-4d3b-9afc-d1ce0beb0d9e tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:00:07.387234 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-ae939bc1-03e4-4d3b-9afc-d1ce0beb0d9e tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:00:07.528669 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-ae939bc1-03e4-4d3b-9afc-d1ce0beb0d9e tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 21:00:07.536844 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-ae939bc1-03e4-4d3b-9afc-d1ce0beb0d9e tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 21:00:07.539169 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-ae939bc1-03e4-4d3b-9afc-d1ce0beb0d9e tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 21:00:07.540349 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-ae939bc1-03e4-4d3b-9afc-d1ce0beb0d9e tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] 10.222.0.20 "GET /compute/v2.1/servers/1b6eabe8-54b0-43cf-94ff-9d4abc8168db" status: 200 len: 1717 microversion: 2.20 time: 0.166849 Jul 05 21:00:07.540894 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 334/658] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 5 21:00:07 2022] GET /compute/v2.1/servers/1b6eabe8-54b0-43cf-94ff-9d4abc8168db => generated 1717 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 21:00:07.599554 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-41eee66d-689d-4f19-845d-06b492d427cc tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 21:00:07.601328 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-41eee66d-689d-4f19-845d-06b492d427cc tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] [instance: eb4c9422-c2c5-4b9a-a86c-a913dfaeda45] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 21:00:07.608307 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-41eee66d-689d-4f19-845d-06b492d427cc tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:00:07.608767 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-41eee66d-689d-4f19-845d-06b492d427cc tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:00:07.609526 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-41eee66d-689d-4f19-845d-06b492d427cc tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:00:07.609953 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-41eee66d-689d-4f19-845d-06b492d427cc tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:00:07.674535 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-41eee66d-689d-4f19-845d-06b492d427cc tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '261feb03a8ff459b8874232bec05034f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9a3d56f8b84eb2a057425afbf79079', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 21:00:07.682505 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-41eee66d-689d-4f19-845d-06b492d427cc tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] 10.222.0.20 "GET /compute/v2.1/servers/eb4c9422-c2c5-4b9a-a86c-a913dfaeda45" status: 200 len: 1135 microversion: 2.1 time: 0.086755 Jul 05 21:00:07.683062 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 325/659] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 21:00:07 2022] GET /compute/v2.1/servers/eb4c9422-c2c5-4b9a-a86c-a913dfaeda45 => generated 1135 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 21:00:08.558640 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-73e6cda3-0aee-4112-9623-711d91069243 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 21:00:08.559246 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-73e6cda3-0aee-4112-9623-711d91069243 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] [instance: 1b6eabe8-54b0-43cf-94ff-9d4abc8168db] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 21:00:08.565763 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-73e6cda3-0aee-4112-9623-711d91069243 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:00:08.566210 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-73e6cda3-0aee-4112-9623-711d91069243 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:00:08.567022 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-73e6cda3-0aee-4112-9623-711d91069243 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:00:08.567376 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-73e6cda3-0aee-4112-9623-711d91069243 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:00:08.695305 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-73e6cda3-0aee-4112-9623-711d91069243 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 21:00:08.697599 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG dbcounter [-] [117628] Writing DB stats nova_cell1:SELECT=100 {{(pid=117628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:00:08.700215 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-dfc98135-3523-47e1-a36a-f8189eadf6e5 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 21:00:08.701432 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-dfc98135-3523-47e1-a36a-f8189eadf6e5 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] [instance: eb4c9422-c2c5-4b9a-a86c-a913dfaeda45] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 21:00:08.704759 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-73e6cda3-0aee-4112-9623-711d91069243 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 21:00:08.706480 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-73e6cda3-0aee-4112-9623-711d91069243 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 21:00:08.707659 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-73e6cda3-0aee-4112-9623-711d91069243 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] 10.222.0.20 "GET /compute/v2.1/servers/1b6eabe8-54b0-43cf-94ff-9d4abc8168db" status: 200 len: 1717 microversion: 2.20 time: 0.152879 Jul 05 21:00:08.708054 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-dfc98135-3523-47e1-a36a-f8189eadf6e5 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:00:08.708487 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 335/660] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 5 21:00:08 2022] GET /compute/v2.1/servers/1b6eabe8-54b0-43cf-94ff-9d4abc8168db => generated 1717 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 21:00:08.708611 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-dfc98135-3523-47e1-a36a-f8189eadf6e5 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:00:08.709485 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-dfc98135-3523-47e1-a36a-f8189eadf6e5 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:00:08.709928 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-dfc98135-3523-47e1-a36a-f8189eadf6e5 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:00:08.779014 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-dfc98135-3523-47e1-a36a-f8189eadf6e5 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '261feb03a8ff459b8874232bec05034f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9a3d56f8b84eb2a057425afbf79079', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 21:00:08.786642 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-dfc98135-3523-47e1-a36a-f8189eadf6e5 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] 10.222.0.20 "GET /compute/v2.1/servers/eb4c9422-c2c5-4b9a-a86c-a913dfaeda45" status: 200 len: 1135 microversion: 2.1 time: 0.090251 Jul 05 21:00:08.787322 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 326/661] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 21:00:08 2022] GET /compute/v2.1/servers/eb4c9422-c2c5-4b9a-a86c-a913dfaeda45 => generated 1135 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 21:00:09.727218 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-dfd4332a-57ae-4914-9eda-fa0c831f3cf9 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 21:00:09.727922 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-dfd4332a-57ae-4914-9eda-fa0c831f3cf9 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] [instance: 1b6eabe8-54b0-43cf-94ff-9d4abc8168db] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 21:00:09.734848 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-dfd4332a-57ae-4914-9eda-fa0c831f3cf9 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:00:09.735392 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-dfd4332a-57ae-4914-9eda-fa0c831f3cf9 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:00:09.736464 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-dfd4332a-57ae-4914-9eda-fa0c831f3cf9 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:00:09.737250 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-dfd4332a-57ae-4914-9eda-fa0c831f3cf9 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:00:09.803734 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-bb5cce68-1f4a-4e6b-be41-7ac93d14e42f tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 21:00:09.804379 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-bb5cce68-1f4a-4e6b-be41-7ac93d14e42f tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] [instance: eb4c9422-c2c5-4b9a-a86c-a913dfaeda45] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 21:00:09.811679 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-bb5cce68-1f4a-4e6b-be41-7ac93d14e42f tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:00:09.812128 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-bb5cce68-1f4a-4e6b-be41-7ac93d14e42f tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:00:09.814018 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-bb5cce68-1f4a-4e6b-be41-7ac93d14e42f tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:00:09.814018 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-bb5cce68-1f4a-4e6b-be41-7ac93d14e42f tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:00:09.917343 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-bb5cce68-1f4a-4e6b-be41-7ac93d14e42f tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '261feb03a8ff459b8874232bec05034f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9a3d56f8b84eb2a057425afbf79079', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 21:00:09.924906 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-bb5cce68-1f4a-4e6b-be41-7ac93d14e42f tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] 10.222.0.20 "GET /compute/v2.1/servers/eb4c9422-c2c5-4b9a-a86c-a913dfaeda45" status: 200 len: 1209 microversion: 2.1 time: 0.125180 Jul 05 21:00:09.925450 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 327/662] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 21:00:09 2022] GET /compute/v2.1/servers/eb4c9422-c2c5-4b9a-a86c-a913dfaeda45 => generated 1209 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 21:00:09.991005 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-dfd4332a-57ae-4914-9eda-fa0c831f3cf9 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 21:00:09.999217 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-dfd4332a-57ae-4914-9eda-fa0c831f3cf9 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 21:00:10.000738 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-dfd4332a-57ae-4914-9eda-fa0c831f3cf9 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 21:00:10.001930 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-dfd4332a-57ae-4914-9eda-fa0c831f3cf9 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] 10.222.0.20 "GET /compute/v2.1/servers/1b6eabe8-54b0-43cf-94ff-9d4abc8168db" status: 200 len: 1660 microversion: 2.20 time: 0.279428 Jul 05 21:00:10.002485 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 336/663] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 5 21:00:09 2022] GET /compute/v2.1/servers/1b6eabe8-54b0-43cf-94ff-9d4abc8168db => generated 1660 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 21:00:10.020922 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-3616aacd-2be7-4bb6-9e38-be6a0916acca tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "76ed9bc1-e121-49e4-804b-26dea1b89a3c"}} {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 21:00:10.022414 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-3616aacd-2be7-4bb6-9e38-be6a0916acca tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] [instance: 1b6eabe8-54b0-43cf-94ff-9d4abc8168db] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 21:00:10.028668 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-3616aacd-2be7-4bb6-9e38-be6a0916acca tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:00:10.029142 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-3616aacd-2be7-4bb6-9e38-be6a0916acca tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:00:10.029892 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-3616aacd-2be7-4bb6-9e38-be6a0916acca tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:00:10.030324 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-3616aacd-2be7-4bb6-9e38-be6a0916acca tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:00:10.307022 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-3616aacd-2be7-4bb6-9e38-be6a0916acca tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] 10.222.0.20 "POST /compute/v2.1/servers/1b6eabe8-54b0-43cf-94ff-9d4abc8168db/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.290462 Jul 05 21:00:10.307971 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 328/664] 10.222.0.20 () {62 vars in 1363 bytes} [Tue Jul 5 21:00:10 2022] POST /compute/v2.1/servers/1b6eabe8-54b0-43cf-94ff-9d4abc8168db/os-volume_attachments => generated 188 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 05 21:00:10.476391 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-2e373cbd-53d6-410d-a5ee-5ab8bfd54334 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 21:00:10.476886 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-2e373cbd-53d6-410d-a5ee-5ab8bfd54334 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] [instance: 1b6eabe8-54b0-43cf-94ff-9d4abc8168db] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 21:00:10.484691 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-2e373cbd-53d6-410d-a5ee-5ab8bfd54334 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:00:10.485185 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-2e373cbd-53d6-410d-a5ee-5ab8bfd54334 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:00:10.485932 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-2e373cbd-53d6-410d-a5ee-5ab8bfd54334 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:00:10.486359 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-2e373cbd-53d6-410d-a5ee-5ab8bfd54334 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:00:10.837238 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-2e373cbd-53d6-410d-a5ee-5ab8bfd54334 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] 10.222.0.20 "DELETE /compute/v2.1/servers/1b6eabe8-54b0-43cf-94ff-9d4abc8168db/os-volume_attachments/76ed9bc1-e121-49e4-804b-26dea1b89a3c" status: 202 len: 0 microversion: 2.20 time: 0.364614 Jul 05 21:00:10.837829 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 337/665] 10.222.0.20 () {60 vars in 1456 bytes} [Tue Jul 5 21:00:10 2022] DELETE /compute/v2.1/servers/1b6eabe8-54b0-43cf-94ff-9d4abc8168db/os-volume_attachments/76ed9bc1-e121-49e4-804b-26dea1b89a3c => generated 0 bytes in 366 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 05 21:00:10.901490 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-0c662398-3b4d-44f5-b11c-ca6f259cda2b tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 21:00:10.902042 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-0c662398-3b4d-44f5-b11c-ca6f259cda2b tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] [instance: 1b6eabe8-54b0-43cf-94ff-9d4abc8168db] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 21:00:10.908620 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-0c662398-3b4d-44f5-b11c-ca6f259cda2b tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:00:10.909105 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-0c662398-3b4d-44f5-b11c-ca6f259cda2b tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:00:10.910062 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-0c662398-3b4d-44f5-b11c-ca6f259cda2b tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:00:10.910499 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-0c662398-3b4d-44f5-b11c-ca6f259cda2b tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:00:10.942252 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-b77affa1-6e34-4b56-bc7c-b673de2396d6 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 21:00:10.942890 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-b77affa1-6e34-4b56-bc7c-b673de2396d6 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] [instance: eb4c9422-c2c5-4b9a-a86c-a913dfaeda45] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 21:00:10.950945 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-b77affa1-6e34-4b56-bc7c-b673de2396d6 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:00:10.951393 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-b77affa1-6e34-4b56-bc7c-b673de2396d6 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:00:10.952170 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-b77affa1-6e34-4b56-bc7c-b673de2396d6 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:00:10.952601 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-b77affa1-6e34-4b56-bc7c-b673de2396d6 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:00:11.249203 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-0c662398-3b4d-44f5-b11c-ca6f259cda2b tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] 10.222.0.20 "POST /compute/v2.1/servers/1b6eabe8-54b0-43cf-94ff-9d4abc8168db/action" status: 202 len: 0 microversion: 2.20 time: 0.350641 Jul 05 21:00:11.250241 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 329/666] 10.222.0.20 () {62 vars in 1318 bytes} [Tue Jul 5 21:00:10 2022] POST /compute/v2.1/servers/1b6eabe8-54b0-43cf-94ff-9d4abc8168db/action => generated 0 bytes in 354 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 05 21:00:11.263208 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-1ad2d584-3378-47b6-8297-306a6bbd539a tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 21:00:11.264662 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-1ad2d584-3378-47b6-8297-306a6bbd539a tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] [instance: 1b6eabe8-54b0-43cf-94ff-9d4abc8168db] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 21:00:11.275141 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-1ad2d584-3378-47b6-8297-306a6bbd539a tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:00:11.275841 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-1ad2d584-3378-47b6-8297-306a6bbd539a tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:00:11.277640 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-1ad2d584-3378-47b6-8297-306a6bbd539a tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:00:11.278608 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-1ad2d584-3378-47b6-8297-306a6bbd539a tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:00:11.282957 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-b77affa1-6e34-4b56-bc7c-b673de2396d6 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '261feb03a8ff459b8874232bec05034f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9a3d56f8b84eb2a057425afbf79079', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 21:00:11.292757 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-b77affa1-6e34-4b56-bc7c-b673de2396d6 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] 10.222.0.20 "GET /compute/v2.1/servers/eb4c9422-c2c5-4b9a-a86c-a913dfaeda45" status: 200 len: 1265 microversion: 2.1 time: 0.354936 Jul 05 21:00:11.293381 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 338/667] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 21:00:10 2022] GET /compute/v2.1/servers/eb4c9422-c2c5-4b9a-a86c-a913dfaeda45 => generated 1265 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 21:00:11.307390 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [req-c8fc129b-08a1-4ae9-b6da-72afeae1bf84 req-90a1f777-80e7-422e-b715-bef36b5db098 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b6eabe8-54b0-43cf-94ff-9d4abc8168db", "name": "network-vif-unplugged", "status": "completed", "tag": "15ebde2f-b2f2-42b3-a2d3-10634ee149d4"}]} {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 21:00:11.332963 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [req-c8fc129b-08a1-4ae9-b6da-72afeae1bf84 req-90a1f777-80e7-422e-b715-bef36b5db098 service nova] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:00:11.352635 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [req-c8fc129b-08a1-4ae9-b6da-72afeae1bf84 req-90a1f777-80e7-422e-b715-bef36b5db098 service nova] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:00:11.373128 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.compute.server_external_events [req-c8fc129b-08a1-4ae9-b6da-72afeae1bf84 req-90a1f777-80e7-422e-b715-bef36b5db098 service nova] Unable to find a host for instance 1b6eabe8-54b0-43cf-94ff-9d4abc8168db. Dropping event network-vif-unplugged {{(pid=117628) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jul 05 21:00:11.374915 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [req-c8fc129b-08a1-4ae9-b6da-72afeae1bf84 req-90a1f777-80e7-422e-b715-bef36b5db098 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.080592 Jul 05 21:00:11.375851 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 339/668] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 5 21:00:11 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 82 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jul 05 21:00:11.523907 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-1ad2d584-3378-47b6-8297-306a6bbd539a tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 21:00:11.538832 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-1ad2d584-3378-47b6-8297-306a6bbd539a tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 21:00:11.540618 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-1ad2d584-3378-47b6-8297-306a6bbd539a tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 21:00:11.542057 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-1ad2d584-3378-47b6-8297-306a6bbd539a tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] 10.222.0.20 "GET /compute/v2.1/servers/1b6eabe8-54b0-43cf-94ff-9d4abc8168db" status: 200 len: 1668 microversion: 2.20 time: 0.287578 Jul 05 21:00:11.546250 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 330/669] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 5 21:00:11 2022] GET /compute/v2.1/servers/1b6eabe8-54b0-43cf-94ff-9d4abc8168db => generated 1668 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 21:00:11.638068 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [req-c84ec0b9-2a81-4b53-a24a-f0643e18635b req-66018af8-e2b5-4514-bfea-c95591e23c16 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eb4c9422-c2c5-4b9a-a86c-a913dfaeda45", "tag": "eae5be01-7130-4460-95d2-13ad37982542"}]} {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 21:00:11.649141 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [req-c84ec0b9-2a81-4b53-a24a-f0643e18635b req-66018af8-e2b5-4514-bfea-c95591e23c16 service nova] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:00:11.657481 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [req-c84ec0b9-2a81-4b53-a24a-f0643e18635b req-66018af8-e2b5-4514-bfea-c95591e23c16 service nova] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:00:11.680996 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.compute.server_external_events [req-c84ec0b9-2a81-4b53-a24a-f0643e18635b req-66018af8-e2b5-4514-bfea-c95591e23c16 service nova] Creating event network-changed:eae5be01-7130-4460-95d2-13ad37982542 for instance eb4c9422-c2c5-4b9a-a86c-a913dfaeda45 on hv-cinder-79760 Jul 05 21:00:11.687627 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [req-c84ec0b9-2a81-4b53-a24a-f0643e18635b req-66018af8-e2b5-4514-bfea-c95591e23c16 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055433 Jul 05 21:00:11.688437 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 340/670] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 5 21:00:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 05 21:00:12.310573 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-3a50767f-974c-4f51-8728-8a4b2054a2d3 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 21:00:12.311254 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-3a50767f-974c-4f51-8728-8a4b2054a2d3 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] [instance: eb4c9422-c2c5-4b9a-a86c-a913dfaeda45] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 21:00:12.322794 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-3a50767f-974c-4f51-8728-8a4b2054a2d3 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:00:12.323261 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-3a50767f-974c-4f51-8728-8a4b2054a2d3 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:00:12.324306 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-3a50767f-974c-4f51-8728-8a4b2054a2d3 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:00:12.324809 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-3a50767f-974c-4f51-8728-8a4b2054a2d3 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:00:12.466134 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-3a50767f-974c-4f51-8728-8a4b2054a2d3 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '261feb03a8ff459b8874232bec05034f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9a3d56f8b84eb2a057425afbf79079', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 21:00:12.477539 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-3a50767f-974c-4f51-8728-8a4b2054a2d3 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] 10.222.0.20 "GET /compute/v2.1/servers/eb4c9422-c2c5-4b9a-a86c-a913dfaeda45" status: 200 len: 1265 microversion: 2.1 time: 0.170717 Jul 05 21:00:12.478193 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 331/671] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 21:00:12 2022] GET /compute/v2.1/servers/eb4c9422-c2c5-4b9a-a86c-a913dfaeda45 => generated 1265 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 21:00:12.561638 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-3df72828-a394-486e-950b-9f111f7ab1ba tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 21:00:12.562340 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-3df72828-a394-486e-950b-9f111f7ab1ba tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] [instance: 1b6eabe8-54b0-43cf-94ff-9d4abc8168db] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 21:00:12.569899 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-3df72828-a394-486e-950b-9f111f7ab1ba tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:00:12.570546 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-3df72828-a394-486e-950b-9f111f7ab1ba tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:00:12.571720 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-3df72828-a394-486e-950b-9f111f7ab1ba tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:00:12.572631 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-3df72828-a394-486e-950b-9f111f7ab1ba tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:00:12.880384 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-3df72828-a394-486e-950b-9f111f7ab1ba tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 21:00:12.890462 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-3df72828-a394-486e-950b-9f111f7ab1ba tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 21:00:12.892086 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-3df72828-a394-486e-950b-9f111f7ab1ba tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 21:00:12.893477 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-3df72828-a394-486e-950b-9f111f7ab1ba tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] 10.222.0.20 "GET /compute/v2.1/servers/1b6eabe8-54b0-43cf-94ff-9d4abc8168db" status: 200 len: 1668 microversion: 2.20 time: 0.336134 Jul 05 21:00:12.894111 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 341/672] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 5 21:00:12 2022] GET /compute/v2.1/servers/1b6eabe8-54b0-43cf-94ff-9d4abc8168db => generated 1668 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 21:00:13.501983 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-77a35128-5c64-4095-9e8f-c4437b91bfd2 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 21:00:13.502590 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-77a35128-5c64-4095-9e8f-c4437b91bfd2 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] [instance: eb4c9422-c2c5-4b9a-a86c-a913dfaeda45] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 21:00:13.512010 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-77a35128-5c64-4095-9e8f-c4437b91bfd2 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:00:13.512881 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-77a35128-5c64-4095-9e8f-c4437b91bfd2 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:00:13.513706 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-77a35128-5c64-4095-9e8f-c4437b91bfd2 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:00:13.514143 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-77a35128-5c64-4095-9e8f-c4437b91bfd2 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:00:13.663272 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-77a35128-5c64-4095-9e8f-c4437b91bfd2 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '261feb03a8ff459b8874232bec05034f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9a3d56f8b84eb2a057425afbf79079', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 21:00:13.672387 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-77a35128-5c64-4095-9e8f-c4437b91bfd2 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] 10.222.0.20 "GET /compute/v2.1/servers/eb4c9422-c2c5-4b9a-a86c-a913dfaeda45" status: 200 len: 1265 microversion: 2.1 time: 0.174595 Jul 05 21:00:13.673409 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 332/673] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 21:00:13 2022] GET /compute/v2.1/servers/eb4c9422-c2c5-4b9a-a86c-a913dfaeda45 => generated 1265 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 21:00:13.913576 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-4e5e666f-ab66-4776-939e-e02c968ca204 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 21:00:13.914754 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-4e5e666f-ab66-4776-939e-e02c968ca204 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] [instance: 1b6eabe8-54b0-43cf-94ff-9d4abc8168db] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 21:00:13.921473 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-4e5e666f-ab66-4776-939e-e02c968ca204 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:00:13.921975 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-4e5e666f-ab66-4776-939e-e02c968ca204 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:00:13.922655 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-4e5e666f-ab66-4776-939e-e02c968ca204 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:00:13.923068 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-4e5e666f-ab66-4776-939e-e02c968ca204 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:00:14.071232 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-4e5e666f-ab66-4776-939e-e02c968ca204 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 21:00:14.080103 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-4e5e666f-ab66-4776-939e-e02c968ca204 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 21:00:14.081774 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-4e5e666f-ab66-4776-939e-e02c968ca204 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 21:00:14.083006 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-4e5e666f-ab66-4776-939e-e02c968ca204 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] 10.222.0.20 "GET /compute/v2.1/servers/1b6eabe8-54b0-43cf-94ff-9d4abc8168db" status: 200 len: 1726 microversion: 2.20 time: 0.173284 Jul 05 21:00:14.083848 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 342/674] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 5 21:00:13 2022] GET /compute/v2.1/servers/1b6eabe8-54b0-43cf-94ff-9d4abc8168db => generated 1726 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 21:00:14.690603 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-ae2bd919-0a70-481d-8d19-68b2aff039a7 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 21:00:14.691235 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-ae2bd919-0a70-481d-8d19-68b2aff039a7 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] [instance: eb4c9422-c2c5-4b9a-a86c-a913dfaeda45] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 21:00:14.698177 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-ae2bd919-0a70-481d-8d19-68b2aff039a7 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:00:14.698958 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-ae2bd919-0a70-481d-8d19-68b2aff039a7 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:00:14.699933 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-ae2bd919-0a70-481d-8d19-68b2aff039a7 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:00:14.700440 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-ae2bd919-0a70-481d-8d19-68b2aff039a7 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:00:14.879908 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-ae2bd919-0a70-481d-8d19-68b2aff039a7 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '261feb03a8ff459b8874232bec05034f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9a3d56f8b84eb2a057425afbf79079', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 21:00:14.888830 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-ae2bd919-0a70-481d-8d19-68b2aff039a7 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] 10.222.0.20 "GET /compute/v2.1/servers/eb4c9422-c2c5-4b9a-a86c-a913dfaeda45" status: 200 len: 1265 microversion: 2.1 time: 0.202132 Jul 05 21:00:14.895263 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 333/675] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 21:00:14 2022] GET /compute/v2.1/servers/eb4c9422-c2c5-4b9a-a86c-a913dfaeda45 => generated 1265 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 21:00:15.102222 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-5f4c68bc-2d53-4591-aa5f-f2ed26397d73 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 21:00:15.102830 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-5f4c68bc-2d53-4591-aa5f-f2ed26397d73 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] [instance: 1b6eabe8-54b0-43cf-94ff-9d4abc8168db] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 21:00:15.109739 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-5f4c68bc-2d53-4591-aa5f-f2ed26397d73 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:00:15.110188 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-5f4c68bc-2d53-4591-aa5f-f2ed26397d73 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:00:15.110961 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-5f4c68bc-2d53-4591-aa5f-f2ed26397d73 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:00:15.111389 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-5f4c68bc-2d53-4591-aa5f-f2ed26397d73 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:00:15.329078 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-5f4c68bc-2d53-4591-aa5f-f2ed26397d73 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 21:00:15.347513 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-5f4c68bc-2d53-4591-aa5f-f2ed26397d73 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 21:00:15.349427 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-5f4c68bc-2d53-4591-aa5f-f2ed26397d73 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 21:00:15.351368 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-5f4c68bc-2d53-4591-aa5f-f2ed26397d73 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] 10.222.0.20 "GET /compute/v2.1/servers/1b6eabe8-54b0-43cf-94ff-9d4abc8168db" status: 200 len: 1726 microversion: 2.20 time: 0.253403 Jul 05 21:00:15.352539 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 343/676] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 5 21:00:15 2022] GET /compute/v2.1/servers/1b6eabe8-54b0-43cf-94ff-9d4abc8168db => generated 1726 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 05 21:00:15.913200 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-ff66feef-51b3-45cf-8c24-eee155dc97fa tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 21:00:15.914663 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-ff66feef-51b3-45cf-8c24-eee155dc97fa tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] [instance: eb4c9422-c2c5-4b9a-a86c-a913dfaeda45] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 21:00:15.922608 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-ff66feef-51b3-45cf-8c24-eee155dc97fa tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:00:15.923296 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-ff66feef-51b3-45cf-8c24-eee155dc97fa tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:00:15.924370 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-ff66feef-51b3-45cf-8c24-eee155dc97fa tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:00:15.925015 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-ff66feef-51b3-45cf-8c24-eee155dc97fa tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:00:16.113734 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-ff66feef-51b3-45cf-8c24-eee155dc97fa tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '261feb03a8ff459b8874232bec05034f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9a3d56f8b84eb2a057425afbf79079', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 21:00:16.131942 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-ff66feef-51b3-45cf-8c24-eee155dc97fa tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] 10.222.0.20 "GET /compute/v2.1/servers/eb4c9422-c2c5-4b9a-a86c-a913dfaeda45" status: 200 len: 1265 microversion: 2.1 time: 0.223707 Jul 05 21:00:16.143256 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 334/677] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 21:00:15 2022] GET /compute/v2.1/servers/eb4c9422-c2c5-4b9a-a86c-a913dfaeda45 => generated 1265 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 21:00:16.373699 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-920165a7-46f2-4d60-b0ba-907cd8aaf5a6 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 21:00:16.374717 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-920165a7-46f2-4d60-b0ba-907cd8aaf5a6 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] [instance: 1b6eabe8-54b0-43cf-94ff-9d4abc8168db] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 21:00:16.378217 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG dbcounter [-] [117628] Writing DB stats nova_cell0:SELECT=2 {{(pid=117628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:00:16.379274 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG dbcounter [-] [117628] Writing DB stats nova_cell0:SELECT=6 {{(pid=117628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:00:16.388214 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-920165a7-46f2-4d60-b0ba-907cd8aaf5a6 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:00:16.388894 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-920165a7-46f2-4d60-b0ba-907cd8aaf5a6 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:00:16.389684 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-920165a7-46f2-4d60-b0ba-907cd8aaf5a6 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:00:16.390111 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-920165a7-46f2-4d60-b0ba-907cd8aaf5a6 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:00:16.550308 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-920165a7-46f2-4d60-b0ba-907cd8aaf5a6 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 21:00:16.558473 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-920165a7-46f2-4d60-b0ba-907cd8aaf5a6 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 21:00:16.560194 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-920165a7-46f2-4d60-b0ba-907cd8aaf5a6 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 21:00:16.561408 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-920165a7-46f2-4d60-b0ba-907cd8aaf5a6 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] 10.222.0.20 "GET /compute/v2.1/servers/1b6eabe8-54b0-43cf-94ff-9d4abc8168db" status: 200 len: 1726 microversion: 2.20 time: 0.193603 Jul 05 21:00:16.561966 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 344/678] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 5 21:00:16 2022] GET /compute/v2.1/servers/1b6eabe8-54b0-43cf-94ff-9d4abc8168db => generated 1726 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 21:00:17.071238 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG dbcounter [-] [117627] Writing DB stats nova_cell0:SELECT=2 {{(pid=117627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:00:17.151460 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-61b944d5-5462-45af-992c-949e15d4fe2d tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 21:00:17.152071 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-61b944d5-5462-45af-992c-949e15d4fe2d tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] [instance: eb4c9422-c2c5-4b9a-a86c-a913dfaeda45] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 21:00:17.162174 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-61b944d5-5462-45af-992c-949e15d4fe2d tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:00:17.162623 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-61b944d5-5462-45af-992c-949e15d4fe2d tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:00:17.163406 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-61b944d5-5462-45af-992c-949e15d4fe2d tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:00:17.163844 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-61b944d5-5462-45af-992c-949e15d4fe2d tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:00:17.356794 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-b44cc679-4b9e-43eb-a183-2d7d4e1b85b9 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 21:00:17.357318 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-b44cc679-4b9e-43eb-a183-2d7d4e1b85b9 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] [instance: 6064b8b7-d821-4db1-86fa-c24015af68c7] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 21:00:17.364667 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-b44cc679-4b9e-43eb-a183-2d7d4e1b85b9 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:00:17.365172 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-b44cc679-4b9e-43eb-a183-2d7d4e1b85b9 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:00:17.365944 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-b44cc679-4b9e-43eb-a183-2d7d4e1b85b9 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:00:17.366385 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-b44cc679-4b9e-43eb-a183-2d7d4e1b85b9 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:00:17.386307 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG dbcounter [-] [117627] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=117627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:00:17.391537 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-61b944d5-5462-45af-992c-949e15d4fe2d tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '261feb03a8ff459b8874232bec05034f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9a3d56f8b84eb2a057425afbf79079', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 21:00:17.401653 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-61b944d5-5462-45af-992c-949e15d4fe2d tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] 10.222.0.20 "GET /compute/v2.1/servers/eb4c9422-c2c5-4b9a-a86c-a913dfaeda45" status: 200 len: 1265 microversion: 2.1 time: 0.254046 Jul 05 21:00:17.402833 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 345/679] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 21:00:17 2022] GET /compute/v2.1/servers/eb4c9422-c2c5-4b9a-a86c-a913dfaeda45 => generated 1265 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 21:00:17.421314 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-b44cc679-4b9e-43eb-a183-2d7d4e1b85b9 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] 10.222.0.20 "GET /compute/v2.1/servers/6064b8b7-d821-4db1-86fa-c24015af68c7/ips" status: 200 len: 146 microversion: 2.1 time: 0.356586 Jul 05 21:00:17.422525 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 335/680] 10.222.0.20 () {58 vars in 1247 bytes} [Tue Jul 5 21:00:17 2022] GET /compute/v2.1/servers/6064b8b7-d821-4db1-86fa-c24015af68c7/ips => generated 146 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 05 21:00:17.580585 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-201c81b2-cacb-4b79-9c77-a8d7c42ee558 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 21:00:17.581670 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-201c81b2-cacb-4b79-9c77-a8d7c42ee558 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] [instance: 1b6eabe8-54b0-43cf-94ff-9d4abc8168db] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 21:00:17.589533 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-201c81b2-cacb-4b79-9c77-a8d7c42ee558 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:00:17.590269 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-201c81b2-cacb-4b79-9c77-a8d7c42ee558 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:00:17.591567 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-201c81b2-cacb-4b79-9c77-a8d7c42ee558 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:00:17.592225 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-201c81b2-cacb-4b79-9c77-a8d7c42ee558 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:00:17.815224 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-201c81b2-cacb-4b79-9c77-a8d7c42ee558 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 21:00:17.848234 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-201c81b2-cacb-4b79-9c77-a8d7c42ee558 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 21:00:17.850667 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-201c81b2-cacb-4b79-9c77-a8d7c42ee558 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 21:00:17.852088 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-201c81b2-cacb-4b79-9c77-a8d7c42ee558 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] 10.222.0.20 "GET /compute/v2.1/servers/1b6eabe8-54b0-43cf-94ff-9d4abc8168db" status: 200 len: 1726 microversion: 2.20 time: 0.276441 Jul 05 21:00:17.861109 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 346/681] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 5 21:00:17 2022] GET /compute/v2.1/servers/1b6eabe8-54b0-43cf-94ff-9d4abc8168db => generated 1726 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 21:00:18.419942 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-cd806d81-be6f-4ef2-962c-bf0f1e3aadda tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 21:00:18.421272 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-cd806d81-be6f-4ef2-962c-bf0f1e3aadda tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] [instance: eb4c9422-c2c5-4b9a-a86c-a913dfaeda45] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 21:00:18.429423 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-cd806d81-be6f-4ef2-962c-bf0f1e3aadda tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:00:18.429924 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-cd806d81-be6f-4ef2-962c-bf0f1e3aadda tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:00:18.430755 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-cd806d81-be6f-4ef2-962c-bf0f1e3aadda tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:00:18.431528 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-cd806d81-be6f-4ef2-962c-bf0f1e3aadda tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:00:18.585520 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-cd806d81-be6f-4ef2-962c-bf0f1e3aadda tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '261feb03a8ff459b8874232bec05034f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9a3d56f8b84eb2a057425afbf79079', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 21:00:18.593956 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-cd806d81-be6f-4ef2-962c-bf0f1e3aadda tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] 10.222.0.20 "GET /compute/v2.1/servers/eb4c9422-c2c5-4b9a-a86c-a913dfaeda45" status: 200 len: 1265 microversion: 2.1 time: 0.177895 Jul 05 21:00:18.604876 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 336/682] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 21:00:18 2022] GET /compute/v2.1/servers/eb4c9422-c2c5-4b9a-a86c-a913dfaeda45 => generated 1265 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 21:00:18.879880 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-f226557c-fac3-4f32-9cc3-643233b7f184 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 21:00:18.881562 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-f226557c-fac3-4f32-9cc3-643233b7f184 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] [instance: 1b6eabe8-54b0-43cf-94ff-9d4abc8168db] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 21:00:18.888148 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-f226557c-fac3-4f32-9cc3-643233b7f184 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:00:18.888594 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-f226557c-fac3-4f32-9cc3-643233b7f184 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:00:18.889392 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-f226557c-fac3-4f32-9cc3-643233b7f184 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:00:18.889829 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-f226557c-fac3-4f32-9cc3-643233b7f184 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:00:19.003619 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-0d95d725-a2d7-4669-8fbd-0c31bbdbf7a1 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d91a8f85-64c9-4432-8de3-d780d44399c4"}} {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 21:00:19.004755 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-0d95d725-a2d7-4669-8fbd-0c31bbdbf7a1 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] [instance: 6064b8b7-d821-4db1-86fa-c24015af68c7] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 21:00:19.011554 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-0d95d725-a2d7-4669-8fbd-0c31bbdbf7a1 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:00:19.012260 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-0d95d725-a2d7-4669-8fbd-0c31bbdbf7a1 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:00:19.013305 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-0d95d725-a2d7-4669-8fbd-0c31bbdbf7a1 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:00:19.013906 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-0d95d725-a2d7-4669-8fbd-0c31bbdbf7a1 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:00:19.059825 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-f226557c-fac3-4f32-9cc3-643233b7f184 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 21:00:19.069901 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-f226557c-fac3-4f32-9cc3-643233b7f184 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 21:00:19.072064 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-f226557c-fac3-4f32-9cc3-643233b7f184 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 21:00:19.073823 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-f226557c-fac3-4f32-9cc3-643233b7f184 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] 10.222.0.20 "GET /compute/v2.1/servers/1b6eabe8-54b0-43cf-94ff-9d4abc8168db" status: 200 len: 1726 microversion: 2.20 time: 0.197852 Jul 05 21:00:19.074881 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 347/683] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 5 21:00:18 2022] GET /compute/v2.1/servers/1b6eabe8-54b0-43cf-94ff-9d4abc8168db => generated 1726 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 05 21:00:19.611912 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-4539e7e6-61ff-4626-a000-51ed0b1e7678 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 21:00:19.612525 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-4539e7e6-61ff-4626-a000-51ed0b1e7678 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] [instance: eb4c9422-c2c5-4b9a-a86c-a913dfaeda45] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 21:00:19.619522 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-4539e7e6-61ff-4626-a000-51ed0b1e7678 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:00:19.620332 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-4539e7e6-61ff-4626-a000-51ed0b1e7678 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:00:19.621381 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-4539e7e6-61ff-4626-a000-51ed0b1e7678 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:00:19.622034 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-4539e7e6-61ff-4626-a000-51ed0b1e7678 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:00:19.775604 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-4539e7e6-61ff-4626-a000-51ed0b1e7678 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '261feb03a8ff459b8874232bec05034f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9a3d56f8b84eb2a057425afbf79079', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 21:00:19.784253 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-4539e7e6-61ff-4626-a000-51ed0b1e7678 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] 10.222.0.20 "GET /compute/v2.1/servers/eb4c9422-c2c5-4b9a-a86c-a913dfaeda45" status: 200 len: 1265 microversion: 2.1 time: 0.176154 Jul 05 21:00:19.785424 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 348/684] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 21:00:19 2022] GET /compute/v2.1/servers/eb4c9422-c2c5-4b9a-a86c-a913dfaeda45 => generated 1265 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 21:00:20.092868 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-5b8224ac-19c6-406d-bd87-7000c47753e6 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 21:00:20.093639 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-5b8224ac-19c6-406d-bd87-7000c47753e6 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] [instance: 1b6eabe8-54b0-43cf-94ff-9d4abc8168db] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 21:00:20.101697 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-5b8224ac-19c6-406d-bd87-7000c47753e6 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:00:20.102141 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-5b8224ac-19c6-406d-bd87-7000c47753e6 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:00:20.102942 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-5b8224ac-19c6-406d-bd87-7000c47753e6 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:00:20.103374 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-5b8224ac-19c6-406d-bd87-7000c47753e6 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:00:20.272128 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-5b8224ac-19c6-406d-bd87-7000c47753e6 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 21:00:20.285956 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-5b8224ac-19c6-406d-bd87-7000c47753e6 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 21:00:20.287603 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-5b8224ac-19c6-406d-bd87-7000c47753e6 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 21:00:20.288863 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-5b8224ac-19c6-406d-bd87-7000c47753e6 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] 10.222.0.20 "GET /compute/v2.1/servers/1b6eabe8-54b0-43cf-94ff-9d4abc8168db" status: 200 len: 1726 microversion: 2.20 time: 0.200112 Jul 05 21:00:20.289829 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 349/685] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 5 21:00:20 2022] GET /compute/v2.1/servers/1b6eabe8-54b0-43cf-94ff-9d4abc8168db => generated 1726 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 05 21:00:20.804104 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-7e549df0-21fd-4542-a505-f25bfbad8d21 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 21:00:20.804711 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-7e549df0-21fd-4542-a505-f25bfbad8d21 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] [instance: eb4c9422-c2c5-4b9a-a86c-a913dfaeda45] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 21:00:20.811892 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-7e549df0-21fd-4542-a505-f25bfbad8d21 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:00:20.812629 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-7e549df0-21fd-4542-a505-f25bfbad8d21 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:00:20.813443 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-7e549df0-21fd-4542-a505-f25bfbad8d21 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:00:20.813964 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-7e549df0-21fd-4542-a505-f25bfbad8d21 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:00:20.956097 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-7e549df0-21fd-4542-a505-f25bfbad8d21 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '261feb03a8ff459b8874232bec05034f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9a3d56f8b84eb2a057425afbf79079', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 21:00:20.965943 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-7e549df0-21fd-4542-a505-f25bfbad8d21 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] 10.222.0.20 "GET /compute/v2.1/servers/eb4c9422-c2c5-4b9a-a86c-a913dfaeda45" status: 200 len: 1265 microversion: 2.1 time: 0.166073 Jul 05 21:00:20.966530 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 350/686] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 21:00:20 2022] GET /compute/v2.1/servers/eb4c9422-c2c5-4b9a-a86c-a913dfaeda45 => generated 1265 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 21:00:21.308242 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-aa5e0e58-805d-4f38-a253-f6910358fa6b tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 21:00:21.308976 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-aa5e0e58-805d-4f38-a253-f6910358fa6b tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] [instance: 1b6eabe8-54b0-43cf-94ff-9d4abc8168db] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 21:00:21.316147 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-aa5e0e58-805d-4f38-a253-f6910358fa6b tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:00:21.316604 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-aa5e0e58-805d-4f38-a253-f6910358fa6b tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:00:21.317448 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-aa5e0e58-805d-4f38-a253-f6910358fa6b tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:00:21.318874 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-aa5e0e58-805d-4f38-a253-f6910358fa6b tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:00:21.323805 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG dbcounter [-] [117628] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=117628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:00:21.464271 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-aa5e0e58-805d-4f38-a253-f6910358fa6b tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 21:00:21.485990 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-aa5e0e58-805d-4f38-a253-f6910358fa6b tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 21:00:21.487682 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-aa5e0e58-805d-4f38-a253-f6910358fa6b tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 21:00:21.488888 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-aa5e0e58-805d-4f38-a253-f6910358fa6b tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] 10.222.0.20 "GET /compute/v2.1/servers/1b6eabe8-54b0-43cf-94ff-9d4abc8168db" status: 200 len: 1726 microversion: 2.20 time: 0.185145 Jul 05 21:00:21.490112 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 351/687] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 5 21:00:21 2022] GET /compute/v2.1/servers/1b6eabe8-54b0-43cf-94ff-9d4abc8168db => generated 1726 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 21:00:21.986948 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-9f14fe9c-cd09-498a-8348-2dbe755b0bd0 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 21:00:21.987587 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-9f14fe9c-cd09-498a-8348-2dbe755b0bd0 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] [instance: eb4c9422-c2c5-4b9a-a86c-a913dfaeda45] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 21:00:21.996461 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-9f14fe9c-cd09-498a-8348-2dbe755b0bd0 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:00:21.996824 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-9f14fe9c-cd09-498a-8348-2dbe755b0bd0 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:00:21.997683 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-9f14fe9c-cd09-498a-8348-2dbe755b0bd0 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:00:21.998177 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-9f14fe9c-cd09-498a-8348-2dbe755b0bd0 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:00:22.158909 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-9f14fe9c-cd09-498a-8348-2dbe755b0bd0 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '261feb03a8ff459b8874232bec05034f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9a3d56f8b84eb2a057425afbf79079', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 21:00:22.167287 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-9f14fe9c-cd09-498a-8348-2dbe755b0bd0 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] 10.222.0.20 "GET /compute/v2.1/servers/eb4c9422-c2c5-4b9a-a86c-a913dfaeda45" status: 200 len: 1265 microversion: 2.1 time: 0.187129 Jul 05 21:00:22.167913 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 352/688] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 21:00:21 2022] GET /compute/v2.1/servers/eb4c9422-c2c5-4b9a-a86c-a913dfaeda45 => generated 1265 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 21:00:22.507904 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-fb68b06d-71a6-4500-ba27-21bd8386676c tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 21:00:22.508620 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-fb68b06d-71a6-4500-ba27-21bd8386676c tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] [instance: 1b6eabe8-54b0-43cf-94ff-9d4abc8168db] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 21:00:22.515004 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-fb68b06d-71a6-4500-ba27-21bd8386676c tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:00:22.515473 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-fb68b06d-71a6-4500-ba27-21bd8386676c tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:00:22.516221 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-fb68b06d-71a6-4500-ba27-21bd8386676c tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:00:22.516683 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-fb68b06d-71a6-4500-ba27-21bd8386676c tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:00:22.674061 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-fb68b06d-71a6-4500-ba27-21bd8386676c tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 21:00:22.683421 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-fb68b06d-71a6-4500-ba27-21bd8386676c tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 21:00:22.684994 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-fb68b06d-71a6-4500-ba27-21bd8386676c tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 21:00:22.686097 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-fb68b06d-71a6-4500-ba27-21bd8386676c tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] 10.222.0.20 "GET /compute/v2.1/servers/1b6eabe8-54b0-43cf-94ff-9d4abc8168db" status: 200 len: 1726 microversion: 2.20 time: 0.182456 Jul 05 21:00:22.686830 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 353/689] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 5 21:00:22 2022] GET /compute/v2.1/servers/1b6eabe8-54b0-43cf-94ff-9d4abc8168db => generated 1726 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 05 21:00:23.184331 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-2a171091-891a-45d2-84f4-1078b5f47e75 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 21:00:23.184991 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-2a171091-891a-45d2-84f4-1078b5f47e75 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] [instance: eb4c9422-c2c5-4b9a-a86c-a913dfaeda45] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 21:00:23.190985 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-2a171091-891a-45d2-84f4-1078b5f47e75 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:00:23.191424 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-2a171091-891a-45d2-84f4-1078b5f47e75 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:00:23.192173 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-2a171091-891a-45d2-84f4-1078b5f47e75 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:00:23.192633 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-2a171091-891a-45d2-84f4-1078b5f47e75 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:00:23.339913 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-2a171091-891a-45d2-84f4-1078b5f47e75 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '261feb03a8ff459b8874232bec05034f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9a3d56f8b84eb2a057425afbf79079', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 21:00:23.347280 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-2a171091-891a-45d2-84f4-1078b5f47e75 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] 10.222.0.20 "GET /compute/v2.1/servers/eb4c9422-c2c5-4b9a-a86c-a913dfaeda45" status: 200 len: 1265 microversion: 2.1 time: 0.166857 Jul 05 21:00:23.347837 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 354/690] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 21:00:23 2022] GET /compute/v2.1/servers/eb4c9422-c2c5-4b9a-a86c-a913dfaeda45 => generated 1265 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 21:00:23.705729 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-89e8b142-565e-477d-8b97-243413dd6117 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 21:00:23.706400 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-89e8b142-565e-477d-8b97-243413dd6117 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] [instance: 1b6eabe8-54b0-43cf-94ff-9d4abc8168db] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 21:00:23.712913 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-89e8b142-565e-477d-8b97-243413dd6117 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:00:23.713738 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-89e8b142-565e-477d-8b97-243413dd6117 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:00:23.714792 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-89e8b142-565e-477d-8b97-243413dd6117 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:00:23.715383 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-89e8b142-565e-477d-8b97-243413dd6117 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:00:23.856033 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-89e8b142-565e-477d-8b97-243413dd6117 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 21:00:23.863837 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-89e8b142-565e-477d-8b97-243413dd6117 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 21:00:23.865493 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-89e8b142-565e-477d-8b97-243413dd6117 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 21:00:23.866663 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-89e8b142-565e-477d-8b97-243413dd6117 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] 10.222.0.20 "GET /compute/v2.1/servers/1b6eabe8-54b0-43cf-94ff-9d4abc8168db" status: 200 len: 1726 microversion: 2.20 time: 0.164946 Jul 05 21:00:23.867214 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 355/691] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 5 21:00:23 2022] GET /compute/v2.1/servers/1b6eabe8-54b0-43cf-94ff-9d4abc8168db => generated 1726 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 05 21:00:24.365370 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-a39a4b26-c6c1-4503-81e3-ff637a11790f tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 21:00:24.365972 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-a39a4b26-c6c1-4503-81e3-ff637a11790f tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] [instance: eb4c9422-c2c5-4b9a-a86c-a913dfaeda45] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 21:00:24.372001 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-a39a4b26-c6c1-4503-81e3-ff637a11790f tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:00:24.372438 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-a39a4b26-c6c1-4503-81e3-ff637a11790f tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:00:24.373215 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-a39a4b26-c6c1-4503-81e3-ff637a11790f tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:00:24.373911 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-a39a4b26-c6c1-4503-81e3-ff637a11790f tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:00:24.512234 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-a39a4b26-c6c1-4503-81e3-ff637a11790f tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '261feb03a8ff459b8874232bec05034f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9a3d56f8b84eb2a057425afbf79079', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 21:00:24.520073 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-a39a4b26-c6c1-4503-81e3-ff637a11790f tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] 10.222.0.20 "GET /compute/v2.1/servers/eb4c9422-c2c5-4b9a-a86c-a913dfaeda45" status: 200 len: 1265 microversion: 2.1 time: 0.158922 Jul 05 21:00:24.521190 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 356/692] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 21:00:24 2022] GET /compute/v2.1/servers/eb4c9422-c2c5-4b9a-a86c-a913dfaeda45 => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 21:00:24.884592 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-220c3490-a5a1-4898-a4e8-f56cf865d298 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 21:00:24.885280 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-220c3490-a5a1-4898-a4e8-f56cf865d298 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] [instance: 1b6eabe8-54b0-43cf-94ff-9d4abc8168db] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 21:00:24.891817 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-220c3490-a5a1-4898-a4e8-f56cf865d298 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:00:24.892258 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-220c3490-a5a1-4898-a4e8-f56cf865d298 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:00:24.893258 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-220c3490-a5a1-4898-a4e8-f56cf865d298 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:00:24.893883 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-220c3490-a5a1-4898-a4e8-f56cf865d298 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:00:25.027234 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-0d95d725-a2d7-4669-8fbd-0c31bbdbf7a1 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] 10.222.0.20 "POST /compute/v2.1/servers/6064b8b7-d821-4db1-86fa-c24015af68c7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 6.031589 Jul 05 21:00:25.027852 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 337/693] 10.222.0.20 () {60 vars in 1322 bytes} [Tue Jul 5 21:00:18 2022] POST /compute/v2.1/servers/6064b8b7-d821-4db1-86fa-c24015af68c7/os-volume_attachments => generated 194 bytes in 6033 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 21:00:25.040521 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-220c3490-a5a1-4898-a4e8-f56cf865d298 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 21:00:25.048560 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-220c3490-a5a1-4898-a4e8-f56cf865d298 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 21:00:25.050081 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-220c3490-a5a1-4898-a4e8-f56cf865d298 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 21:00:25.051181 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-220c3490-a5a1-4898-a4e8-f56cf865d298 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] 10.222.0.20 "GET /compute/v2.1/servers/1b6eabe8-54b0-43cf-94ff-9d4abc8168db" status: 200 len: 1726 microversion: 2.20 time: 0.171099 Jul 05 21:00:25.052265 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 357/694] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 5 21:00:24 2022] GET /compute/v2.1/servers/1b6eabe8-54b0-43cf-94ff-9d4abc8168db => generated 1726 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 05 21:00:25.538629 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-5bbaefee-f417-4d32-bc65-622ecb19165b tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 21:00:25.539334 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-5bbaefee-f417-4d32-bc65-622ecb19165b tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] [instance: eb4c9422-c2c5-4b9a-a86c-a913dfaeda45] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 21:00:25.546742 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-5bbaefee-f417-4d32-bc65-622ecb19165b tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:00:25.547189 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-5bbaefee-f417-4d32-bc65-622ecb19165b tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:00:25.547941 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-5bbaefee-f417-4d32-bc65-622ecb19165b tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:00:25.548374 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-5bbaefee-f417-4d32-bc65-622ecb19165b tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:00:25.685826 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-5bbaefee-f417-4d32-bc65-622ecb19165b tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '261feb03a8ff459b8874232bec05034f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9a3d56f8b84eb2a057425afbf79079', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 21:00:25.693520 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-5bbaefee-f417-4d32-bc65-622ecb19165b tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] 10.222.0.20 "GET /compute/v2.1/servers/eb4c9422-c2c5-4b9a-a86c-a913dfaeda45" status: 200 len: 1265 microversion: 2.1 time: 0.159671 Jul 05 21:00:25.694086 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 338/695] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 21:00:25 2022] GET /compute/v2.1/servers/eb4c9422-c2c5-4b9a-a86c-a913dfaeda45 => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 21:00:26.070844 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-cce7e2fb-8836-4847-88c8-c45a70e77b89 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 21:00:26.071443 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-cce7e2fb-8836-4847-88c8-c45a70e77b89 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] [instance: 1b6eabe8-54b0-43cf-94ff-9d4abc8168db] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 21:00:26.078126 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-cce7e2fb-8836-4847-88c8-c45a70e77b89 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:00:26.078566 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-cce7e2fb-8836-4847-88c8-c45a70e77b89 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:00:26.079325 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-cce7e2fb-8836-4847-88c8-c45a70e77b89 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:00:26.079757 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-cce7e2fb-8836-4847-88c8-c45a70e77b89 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:00:26.213975 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-cce7e2fb-8836-4847-88c8-c45a70e77b89 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 21:00:26.222161 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-cce7e2fb-8836-4847-88c8-c45a70e77b89 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 21:00:26.224253 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-cce7e2fb-8836-4847-88c8-c45a70e77b89 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 21:00:26.225447 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-cce7e2fb-8836-4847-88c8-c45a70e77b89 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] 10.222.0.20 "GET /compute/v2.1/servers/1b6eabe8-54b0-43cf-94ff-9d4abc8168db" status: 200 len: 1726 microversion: 2.20 time: 0.159205 Jul 05 21:00:26.226224 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 358/696] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 5 21:00:26 2022] GET /compute/v2.1/servers/1b6eabe8-54b0-43cf-94ff-9d4abc8168db => generated 1726 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 05 21:00:26.711476 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-5fc96053-9b52-4589-b25c-897a9586a3be tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 21:00:26.712083 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-5fc96053-9b52-4589-b25c-897a9586a3be tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] [instance: eb4c9422-c2c5-4b9a-a86c-a913dfaeda45] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 21:00:26.719361 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-5fc96053-9b52-4589-b25c-897a9586a3be tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:00:26.719738 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-5fc96053-9b52-4589-b25c-897a9586a3be tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:00:26.720489 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-5fc96053-9b52-4589-b25c-897a9586a3be tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:00:26.720979 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-5fc96053-9b52-4589-b25c-897a9586a3be tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:00:26.866923 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-5fc96053-9b52-4589-b25c-897a9586a3be tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '261feb03a8ff459b8874232bec05034f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9a3d56f8b84eb2a057425afbf79079', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 21:00:26.874762 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-5fc96053-9b52-4589-b25c-897a9586a3be tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] 10.222.0.20 "GET /compute/v2.1/servers/eb4c9422-c2c5-4b9a-a86c-a913dfaeda45" status: 200 len: 1265 microversion: 2.1 time: 0.167609 Jul 05 21:00:26.875341 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 339/697] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 21:00:26 2022] GET /compute/v2.1/servers/eb4c9422-c2c5-4b9a-a86c-a913dfaeda45 => generated 1265 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 21:00:27.244985 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-2cee62cb-8d90-436c-b7b2-9087bcf49ce9 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 21:00:27.245791 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-2cee62cb-8d90-436c-b7b2-9087bcf49ce9 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] [instance: 1b6eabe8-54b0-43cf-94ff-9d4abc8168db] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 21:00:27.252980 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-2cee62cb-8d90-436c-b7b2-9087bcf49ce9 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:00:27.253423 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-2cee62cb-8d90-436c-b7b2-9087bcf49ce9 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:00:27.254182 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-2cee62cb-8d90-436c-b7b2-9087bcf49ce9 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:00:27.254608 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-2cee62cb-8d90-436c-b7b2-9087bcf49ce9 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:00:27.396340 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-2cee62cb-8d90-436c-b7b2-9087bcf49ce9 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 21:00:27.404361 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-2cee62cb-8d90-436c-b7b2-9087bcf49ce9 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 21:00:27.405880 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-2cee62cb-8d90-436c-b7b2-9087bcf49ce9 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 21:00:27.407019 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-2cee62cb-8d90-436c-b7b2-9087bcf49ce9 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] 10.222.0.20 "GET /compute/v2.1/servers/1b6eabe8-54b0-43cf-94ff-9d4abc8168db" status: 200 len: 1726 microversion: 2.20 time: 0.167739 Jul 05 21:00:27.407574 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 359/698] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 5 21:00:27 2022] GET /compute/v2.1/servers/1b6eabe8-54b0-43cf-94ff-9d4abc8168db => generated 1726 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 21:00:27.892005 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-61ac0dc8-095e-4999-b707-840267effee9 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 21:00:27.892542 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-61ac0dc8-095e-4999-b707-840267effee9 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] [instance: eb4c9422-c2c5-4b9a-a86c-a913dfaeda45] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 21:00:27.899666 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-61ac0dc8-095e-4999-b707-840267effee9 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:00:27.900107 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-61ac0dc8-095e-4999-b707-840267effee9 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:00:27.900861 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-61ac0dc8-095e-4999-b707-840267effee9 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:00:27.901319 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-61ac0dc8-095e-4999-b707-840267effee9 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:00:28.049874 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-61ac0dc8-095e-4999-b707-840267effee9 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '261feb03a8ff459b8874232bec05034f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9a3d56f8b84eb2a057425afbf79079', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 21:00:28.058281 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-61ac0dc8-095e-4999-b707-840267effee9 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] 10.222.0.20 "GET /compute/v2.1/servers/eb4c9422-c2c5-4b9a-a86c-a913dfaeda45" status: 200 len: 1265 microversion: 2.1 time: 0.170528 Jul 05 21:00:28.058861 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 340/699] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 21:00:27 2022] GET /compute/v2.1/servers/eb4c9422-c2c5-4b9a-a86c-a913dfaeda45 => generated 1265 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 21:00:28.426244 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-5c6ced1c-660d-4dfa-bd4a-277cbb12b544 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 21:00:28.426952 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-5c6ced1c-660d-4dfa-bd4a-277cbb12b544 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] [instance: 1b6eabe8-54b0-43cf-94ff-9d4abc8168db] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 21:00:28.429651 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG dbcounter [-] [117628] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=3 {{(pid=117628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:00:28.434923 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-5c6ced1c-660d-4dfa-bd4a-277cbb12b544 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:00:28.435392 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-5c6ced1c-660d-4dfa-bd4a-277cbb12b544 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:00:28.436162 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-5c6ced1c-660d-4dfa-bd4a-277cbb12b544 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:00:28.436593 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-5c6ced1c-660d-4dfa-bd4a-277cbb12b544 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:00:28.830446 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-5c6ced1c-660d-4dfa-bd4a-277cbb12b544 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 21:00:28.838500 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-5c6ced1c-660d-4dfa-bd4a-277cbb12b544 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 21:00:28.839993 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-5c6ced1c-660d-4dfa-bd4a-277cbb12b544 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 21:00:28.841346 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-5c6ced1c-660d-4dfa-bd4a-277cbb12b544 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] 10.222.0.20 "GET /compute/v2.1/servers/1b6eabe8-54b0-43cf-94ff-9d4abc8168db" status: 200 len: 1726 microversion: 2.20 time: 0.419197 Jul 05 21:00:28.842192 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 360/700] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 5 21:00:28 2022] GET /compute/v2.1/servers/1b6eabe8-54b0-43cf-94ff-9d4abc8168db => generated 1726 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 21:00:29.075389 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-8b4e86c5-7b3c-468f-92f8-2e1a650fda06 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 21:00:29.075993 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-8b4e86c5-7b3c-468f-92f8-2e1a650fda06 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] [instance: eb4c9422-c2c5-4b9a-a86c-a913dfaeda45] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 21:00:29.078445 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG dbcounter [-] [117627] Writing DB stats nova_api:SELECT=59,nova_api:UPDATE=1 {{(pid=117627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:00:29.084313 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-8b4e86c5-7b3c-468f-92f8-2e1a650fda06 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:00:29.084757 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-8b4e86c5-7b3c-468f-92f8-2e1a650fda06 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:00:29.085537 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-8b4e86c5-7b3c-468f-92f8-2e1a650fda06 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:00:29.085965 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-8b4e86c5-7b3c-468f-92f8-2e1a650fda06 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:00:29.226988 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-8b4e86c5-7b3c-468f-92f8-2e1a650fda06 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '261feb03a8ff459b8874232bec05034f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9a3d56f8b84eb2a057425afbf79079', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 21:00:29.234694 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-8b4e86c5-7b3c-468f-92f8-2e1a650fda06 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] 10.222.0.20 "GET /compute/v2.1/servers/eb4c9422-c2c5-4b9a-a86c-a913dfaeda45" status: 200 len: 1265 microversion: 2.1 time: 0.163110 Jul 05 21:00:29.235256 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 341/701] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 21:00:29 2022] GET /compute/v2.1/servers/eb4c9422-c2c5-4b9a-a86c-a913dfaeda45 => generated 1265 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 21:00:29.444360 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [req-62576988-f605-4eb9-9a7b-f33e7642ae28 req-ad9c26f0-b149-4989-bec1-0ab3058f2d4e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b6eabe8-54b0-43cf-94ff-9d4abc8168db", "name": "network-vif-plugged", "status": "completed", "tag": "15ebde2f-b2f2-42b3-a2d3-10634ee149d4"}]} {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 21:00:29.452916 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [req-62576988-f605-4eb9-9a7b-f33e7642ae28 req-ad9c26f0-b149-4989-bec1-0ab3058f2d4e service nova] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:00:29.453530 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [req-62576988-f605-4eb9-9a7b-f33e7642ae28 req-ad9c26f0-b149-4989-bec1-0ab3058f2d4e service nova] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:00:29.468199 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.compute.server_external_events [req-62576988-f605-4eb9-9a7b-f33e7642ae28 req-ad9c26f0-b149-4989-bec1-0ab3058f2d4e service nova] Creating event network-vif-plugged:15ebde2f-b2f2-42b3-a2d3-10634ee149d4 for instance 1b6eabe8-54b0-43cf-94ff-9d4abc8168db on hv-cinder-79760 Jul 05 21:00:29.474394 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [req-62576988-f605-4eb9-9a7b-f33e7642ae28 req-ad9c26f0-b149-4989-bec1-0ab3058f2d4e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033264 Jul 05 21:00:29.475147 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 361/702] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 5 21:00:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 21:00:29.859638 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-b8d71f64-b6a5-4b47-acf9-928795b16d45 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 21:00:29.860167 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-b8d71f64-b6a5-4b47-acf9-928795b16d45 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] [instance: 1b6eabe8-54b0-43cf-94ff-9d4abc8168db] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 21:00:29.867948 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-b8d71f64-b6a5-4b47-acf9-928795b16d45 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:00:29.868387 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-b8d71f64-b6a5-4b47-acf9-928795b16d45 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:00:29.869175 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-b8d71f64-b6a5-4b47-acf9-928795b16d45 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:00:29.869691 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-b8d71f64-b6a5-4b47-acf9-928795b16d45 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:00:29.999163 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-b8d71f64-b6a5-4b47-acf9-928795b16d45 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 21:00:30.007823 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-b8d71f64-b6a5-4b47-acf9-928795b16d45 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 21:00:30.009357 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-b8d71f64-b6a5-4b47-acf9-928795b16d45 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 21:00:30.010495 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-b8d71f64-b6a5-4b47-acf9-928795b16d45 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] 10.222.0.20 "GET /compute/v2.1/servers/1b6eabe8-54b0-43cf-94ff-9d4abc8168db" status: 200 len: 1726 microversion: 2.20 time: 0.154825 Jul 05 21:00:30.011054 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 342/703] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 5 21:00:29 2022] GET /compute/v2.1/servers/1b6eabe8-54b0-43cf-94ff-9d4abc8168db => generated 1726 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 21:00:30.252187 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-c4df8539-ccdd-492e-baf1-64cfd000b223 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 21:00:30.252792 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-c4df8539-ccdd-492e-baf1-64cfd000b223 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] [instance: eb4c9422-c2c5-4b9a-a86c-a913dfaeda45] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 21:00:30.259526 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-c4df8539-ccdd-492e-baf1-64cfd000b223 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:00:30.259964 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-c4df8539-ccdd-492e-baf1-64cfd000b223 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:00:30.260708 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-c4df8539-ccdd-492e-baf1-64cfd000b223 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:00:30.261164 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-c4df8539-ccdd-492e-baf1-64cfd000b223 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:00:30.390291 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-c4df8539-ccdd-492e-baf1-64cfd000b223 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '261feb03a8ff459b8874232bec05034f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9a3d56f8b84eb2a057425afbf79079', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 21:00:30.398047 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-c4df8539-ccdd-492e-baf1-64cfd000b223 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] 10.222.0.20 "GET /compute/v2.1/servers/eb4c9422-c2c5-4b9a-a86c-a913dfaeda45" status: 200 len: 1265 microversion: 2.1 time: 0.150145 Jul 05 21:00:30.398614 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 362/704] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 21:00:30 2022] GET /compute/v2.1/servers/eb4c9422-c2c5-4b9a-a86c-a913dfaeda45 => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 21:00:31.029326 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-5ae521ce-4d98-48d5-995b-c89f1b2de70a tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 21:00:31.029927 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-5ae521ce-4d98-48d5-995b-c89f1b2de70a tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] [instance: 1b6eabe8-54b0-43cf-94ff-9d4abc8168db] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 21:00:31.036830 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-5ae521ce-4d98-48d5-995b-c89f1b2de70a tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:00:31.037405 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-5ae521ce-4d98-48d5-995b-c89f1b2de70a tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:00:31.038159 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-5ae521ce-4d98-48d5-995b-c89f1b2de70a tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:00:31.038588 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-5ae521ce-4d98-48d5-995b-c89f1b2de70a tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:00:31.177129 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-5ae521ce-4d98-48d5-995b-c89f1b2de70a tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 21:00:31.185961 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-5ae521ce-4d98-48d5-995b-c89f1b2de70a tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 21:00:31.187804 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-5ae521ce-4d98-48d5-995b-c89f1b2de70a tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 21:00:31.189003 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-5ae521ce-4d98-48d5-995b-c89f1b2de70a tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] 10.222.0.20 "GET /compute/v2.1/servers/1b6eabe8-54b0-43cf-94ff-9d4abc8168db" status: 200 len: 1726 microversion: 2.20 time: 0.163466 Jul 05 21:00:31.189536 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 343/705] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 5 21:00:31 2022] GET /compute/v2.1/servers/1b6eabe8-54b0-43cf-94ff-9d4abc8168db => generated 1726 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 21:00:31.416999 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-aab68e31-8784-46d2-9df3-d012b1c56864 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 21:00:31.418135 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-aab68e31-8784-46d2-9df3-d012b1c56864 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] [instance: eb4c9422-c2c5-4b9a-a86c-a913dfaeda45] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 21:00:31.427642 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-aab68e31-8784-46d2-9df3-d012b1c56864 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:00:31.429101 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-aab68e31-8784-46d2-9df3-d012b1c56864 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:00:31.430336 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-aab68e31-8784-46d2-9df3-d012b1c56864 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:00:31.431004 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-aab68e31-8784-46d2-9df3-d012b1c56864 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:00:31.494906 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [req-097c1862-89a8-4b66-a834-ff98556a6a54 req-28e022c9-6a93-4211-9f3d-ac1078394611 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb4c9422-c2c5-4b9a-a86c-a913dfaeda45", "name": "network-vif-plugged", "status": "completed", "tag": "eae5be01-7130-4460-95d2-13ad37982542"}]} {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 21:00:31.504122 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [req-097c1862-89a8-4b66-a834-ff98556a6a54 req-28e022c9-6a93-4211-9f3d-ac1078394611 service nova] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:00:31.505356 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [req-097c1862-89a8-4b66-a834-ff98556a6a54 req-28e022c9-6a93-4211-9f3d-ac1078394611 service nova] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:00:31.516009 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.compute.server_external_events [req-097c1862-89a8-4b66-a834-ff98556a6a54 req-28e022c9-6a93-4211-9f3d-ac1078394611 service nova] Creating event network-vif-plugged:eae5be01-7130-4460-95d2-13ad37982542 for instance eb4c9422-c2c5-4b9a-a86c-a913dfaeda45 on hv-cinder-79760 Jul 05 21:00:31.523028 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [req-097c1862-89a8-4b66-a834-ff98556a6a54 req-28e022c9-6a93-4211-9f3d-ac1078394611 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032199 Jul 05 21:00:31.523848 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 344/706] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 5 21:00:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 05 21:00:31.570575 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-aab68e31-8784-46d2-9df3-d012b1c56864 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '261feb03a8ff459b8874232bec05034f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9a3d56f8b84eb2a057425afbf79079', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 21:00:31.578133 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-aab68e31-8784-46d2-9df3-d012b1c56864 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] 10.222.0.20 "GET /compute/v2.1/servers/eb4c9422-c2c5-4b9a-a86c-a913dfaeda45" status: 200 len: 1265 microversion: 2.1 time: 0.167296 Jul 05 21:00:31.578697 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 363/707] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 21:00:31 2022] GET /compute/v2.1/servers/eb4c9422-c2c5-4b9a-a86c-a913dfaeda45 => generated 1265 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 21:00:32.207950 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-ce91e8e5-190b-4fce-887e-767e60d5650b tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 21:00:32.208656 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-ce91e8e5-190b-4fce-887e-767e60d5650b tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] [instance: 1b6eabe8-54b0-43cf-94ff-9d4abc8168db] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 21:00:32.214804 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-ce91e8e5-190b-4fce-887e-767e60d5650b tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:00:32.215241 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-ce91e8e5-190b-4fce-887e-767e60d5650b tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:00:32.215983 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-ce91e8e5-190b-4fce-887e-767e60d5650b tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:00:32.216408 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-ce91e8e5-190b-4fce-887e-767e60d5650b tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:00:32.346215 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-ce91e8e5-190b-4fce-887e-767e60d5650b tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 21:00:32.354620 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-ce91e8e5-190b-4fce-887e-767e60d5650b tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 21:00:32.356100 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-ce91e8e5-190b-4fce-887e-767e60d5650b tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 21:00:32.357263 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-ce91e8e5-190b-4fce-887e-767e60d5650b tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] 10.222.0.20 "GET /compute/v2.1/servers/1b6eabe8-54b0-43cf-94ff-9d4abc8168db" status: 200 len: 1713 microversion: 2.20 time: 0.154116 Jul 05 21:00:32.357818 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 345/708] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 5 21:00:32 2022] GET /compute/v2.1/servers/1b6eabe8-54b0-43cf-94ff-9d4abc8168db => generated 1713 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 21:00:32.595775 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-c9d5a6de-5fd7-429f-91a9-826a6e046760 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 21:00:32.596319 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-c9d5a6de-5fd7-429f-91a9-826a6e046760 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] [instance: eb4c9422-c2c5-4b9a-a86c-a913dfaeda45] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 21:00:32.603690 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-c9d5a6de-5fd7-429f-91a9-826a6e046760 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:00:32.604140 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-c9d5a6de-5fd7-429f-91a9-826a6e046760 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:00:32.604907 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-c9d5a6de-5fd7-429f-91a9-826a6e046760 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:00:32.605373 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-c9d5a6de-5fd7-429f-91a9-826a6e046760 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:00:32.733659 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-c9d5a6de-5fd7-429f-91a9-826a6e046760 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '261feb03a8ff459b8874232bec05034f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9a3d56f8b84eb2a057425afbf79079', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 21:00:32.741246 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-c9d5a6de-5fd7-429f-91a9-826a6e046760 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] 10.222.0.20 "GET /compute/v2.1/servers/eb4c9422-c2c5-4b9a-a86c-a913dfaeda45" status: 200 len: 1265 microversion: 2.1 time: 0.149374 Jul 05 21:00:32.742042 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 364/709] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 21:00:32 2022] GET /compute/v2.1/servers/eb4c9422-c2c5-4b9a-a86c-a913dfaeda45 => generated 1265 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 21:00:33.612758 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-46395fbb-9421-4ed6-8d0c-0cabc72335bd tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 21:00:33.614375 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-46395fbb-9421-4ed6-8d0c-0cabc72335bd tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] [instance: 6064b8b7-d821-4db1-86fa-c24015af68c7] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 21:00:33.620529 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-46395fbb-9421-4ed6-8d0c-0cabc72335bd tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:00:33.621001 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-46395fbb-9421-4ed6-8d0c-0cabc72335bd tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:00:33.621759 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-46395fbb-9421-4ed6-8d0c-0cabc72335bd tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:00:33.622187 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-46395fbb-9421-4ed6-8d0c-0cabc72335bd tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:00:33.655141 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-46395fbb-9421-4ed6-8d0c-0cabc72335bd tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] 10.222.0.20 "GET /compute/v2.1/servers/6064b8b7-d821-4db1-86fa-c24015af68c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046904 Jul 05 21:00:33.655705 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 346/710] 10.222.0.20 () {58 vars in 1301 bytes} [Tue Jul 5 21:00:33 2022] GET /compute/v2.1/servers/6064b8b7-d821-4db1-86fa-c24015af68c7/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 21:00:33.666449 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-a26938ec-4bbd-4074-942b-bb95899a5cf5 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 21:00:33.666997 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-a26938ec-4bbd-4074-942b-bb95899a5cf5 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] [instance: 6064b8b7-d821-4db1-86fa-c24015af68c7] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 21:00:33.673782 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-a26938ec-4bbd-4074-942b-bb95899a5cf5 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:00:33.674254 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-a26938ec-4bbd-4074-942b-bb95899a5cf5 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:00:33.675022 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-a26938ec-4bbd-4074-942b-bb95899a5cf5 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:00:33.675460 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-a26938ec-4bbd-4074-942b-bb95899a5cf5 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:00:33.705146 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-a26938ec-4bbd-4074-942b-bb95899a5cf5 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] 10.222.0.20 "GET /compute/v2.1/servers/6064b8b7-d821-4db1-86fa-c24015af68c7/os-volume_attachments/d91a8f85-64c9-4432-8de3-d780d44399c4" status: 200 len: 194 microversion: 2.1 time: 0.042706 Jul 05 21:00:33.705781 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 365/711] 10.222.0.20 () {58 vars in 1412 bytes} [Tue Jul 5 21:00:33 2022] GET /compute/v2.1/servers/6064b8b7-d821-4db1-86fa-c24015af68c7/os-volume_attachments/d91a8f85-64c9-4432-8de3-d780d44399c4 => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 21:00:33.757994 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-f2e2556c-549b-4b44-bd43-474cfcd35196 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 21:00:33.758741 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-f2e2556c-549b-4b44-bd43-474cfcd35196 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] [instance: eb4c9422-c2c5-4b9a-a86c-a913dfaeda45] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 21:00:33.773069 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-f2e2556c-549b-4b44-bd43-474cfcd35196 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:00:33.773524 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-f2e2556c-549b-4b44-bd43-474cfcd35196 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:00:33.774410 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-f2e2556c-549b-4b44-bd43-474cfcd35196 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:00:33.774770 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-f2e2556c-549b-4b44-bd43-474cfcd35196 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:00:33.939592 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-f2e2556c-549b-4b44-bd43-474cfcd35196 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '261feb03a8ff459b8874232bec05034f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9a3d56f8b84eb2a057425afbf79079', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 21:00:33.955169 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-f2e2556c-549b-4b44-bd43-474cfcd35196 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] 10.222.0.20 "GET /compute/v2.1/servers/eb4c9422-c2c5-4b9a-a86c-a913dfaeda45" status: 200 len: 1265 microversion: 2.1 time: 0.201070 Jul 05 21:00:33.956784 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 347/712] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 21:00:33 2022] GET /compute/v2.1/servers/eb4c9422-c2c5-4b9a-a86c-a913dfaeda45 => generated 1265 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 21:00:34.973966 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-84e5a2d8-5c79-46a3-9fc6-dcbbd499ad0b tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 21:00:34.974522 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-84e5a2d8-5c79-46a3-9fc6-dcbbd499ad0b tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] [instance: eb4c9422-c2c5-4b9a-a86c-a913dfaeda45] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 21:00:34.980976 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-84e5a2d8-5c79-46a3-9fc6-dcbbd499ad0b tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:00:34.981421 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-84e5a2d8-5c79-46a3-9fc6-dcbbd499ad0b tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:00:34.982169 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-84e5a2d8-5c79-46a3-9fc6-dcbbd499ad0b tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:00:34.982596 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-84e5a2d8-5c79-46a3-9fc6-dcbbd499ad0b tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:00:35.050776 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-c37e9d54-6399-4592-9ba7-543a6275bbb6 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1d098fcf-f43c-4559-8b0a-0894708b8d24"}} {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 21:00:35.052577 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-c37e9d54-6399-4592-9ba7-543a6275bbb6 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] [instance: 6064b8b7-d821-4db1-86fa-c24015af68c7] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 21:00:35.058939 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-c37e9d54-6399-4592-9ba7-543a6275bbb6 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:00:35.059391 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-c37e9d54-6399-4592-9ba7-543a6275bbb6 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:00:35.060155 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-c37e9d54-6399-4592-9ba7-543a6275bbb6 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:00:35.060594 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-c37e9d54-6399-4592-9ba7-543a6275bbb6 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:00:35.119890 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-84e5a2d8-5c79-46a3-9fc6-dcbbd499ad0b tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '261feb03a8ff459b8874232bec05034f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9a3d56f8b84eb2a057425afbf79079', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 21:00:35.127470 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-84e5a2d8-5c79-46a3-9fc6-dcbbd499ad0b tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] 10.222.0.20 "GET /compute/v2.1/servers/eb4c9422-c2c5-4b9a-a86c-a913dfaeda45" status: 200 len: 1452 microversion: 2.1 time: 0.157576 Jul 05 21:00:35.128004 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 366/713] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 21:00:34 2022] GET /compute/v2.1/servers/eb4c9422-c2c5-4b9a-a86c-a913dfaeda45 => generated 1452 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 21:00:35.143797 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-9955178d-57fc-45ef-8da6-97e7b223884c tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 21:00:35.144661 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-9955178d-57fc-45ef-8da6-97e7b223884c tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] [instance: eb4c9422-c2c5-4b9a-a86c-a913dfaeda45] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 21:00:35.150622 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-9955178d-57fc-45ef-8da6-97e7b223884c tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:00:35.151067 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-9955178d-57fc-45ef-8da6-97e7b223884c tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:00:35.151833 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-9955178d-57fc-45ef-8da6-97e7b223884c tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:00:35.152264 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-9955178d-57fc-45ef-8da6-97e7b223884c tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:00:35.294372 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-9955178d-57fc-45ef-8da6-97e7b223884c tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '261feb03a8ff459b8874232bec05034f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9a3d56f8b84eb2a057425afbf79079', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 21:00:35.303777 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-9955178d-57fc-45ef-8da6-97e7b223884c tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] 10.222.0.20 "GET /compute/v2.1/servers/eb4c9422-c2c5-4b9a-a86c-a913dfaeda45" status: 200 len: 1452 microversion: 2.1 time: 0.163540 Jul 05 21:00:35.304349 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 367/714] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 21:00:35 2022] GET /compute/v2.1/servers/eb4c9422-c2c5-4b9a-a86c-a913dfaeda45 => generated 1452 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 21:00:35.349554 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-c37e9d54-6399-4592-9ba7-543a6275bbb6 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] 10.222.0.20 "POST /compute/v2.1/servers/6064b8b7-d821-4db1-86fa-c24015af68c7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.301591 Jul 05 21:00:35.352965 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 348/715] 10.222.0.20 () {60 vars in 1322 bytes} [Tue Jul 5 21:00:35 2022] POST /compute/v2.1/servers/6064b8b7-d821-4db1-86fa-c24015af68c7/os-volume_attachments => generated 194 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 05 21:00:37.127376 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [req-4ed4ebf8-4d9e-4695-a563-02909187f886 req-c9e1b28d-475c-485b-b3e2-d2c215bbda90 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eb4c9422-c2c5-4b9a-a86c-a913dfaeda45", "tag": "eae5be01-7130-4460-95d2-13ad37982542"}]} {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 21:00:37.137014 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [req-4ed4ebf8-4d9e-4695-a563-02909187f886 req-c9e1b28d-475c-485b-b3e2-d2c215bbda90 service nova] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:00:37.137699 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [req-4ed4ebf8-4d9e-4695-a563-02909187f886 req-c9e1b28d-475c-485b-b3e2-d2c215bbda90 service nova] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:00:37.150660 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.compute.server_external_events [req-4ed4ebf8-4d9e-4695-a563-02909187f886 req-c9e1b28d-475c-485b-b3e2-d2c215bbda90 service nova] Creating event network-changed:eae5be01-7130-4460-95d2-13ad37982542 for instance eb4c9422-c2c5-4b9a-a86c-a913dfaeda45 on hv-cinder-79760 Jul 05 21:00:37.156085 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [req-4ed4ebf8-4d9e-4695-a563-02909187f886 req-c9e1b28d-475c-485b-b3e2-d2c215bbda90 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032205 Jul 05 21:00:37.157043 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 368/716] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 5 21:00:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 21:00:42.887148 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-5a272c5c-7f07-4de6-a948-139d0344adcd tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 21:00:42.888199 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-5a272c5c-7f07-4de6-a948-139d0344adcd tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] [instance: 6064b8b7-d821-4db1-86fa-c24015af68c7] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 21:00:42.894980 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-5a272c5c-7f07-4de6-a948-139d0344adcd tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:00:42.895538 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-5a272c5c-7f07-4de6-a948-139d0344adcd tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:00:42.896301 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-5a272c5c-7f07-4de6-a948-139d0344adcd tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:00:42.896736 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-5a272c5c-7f07-4de6-a948-139d0344adcd tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:00:42.927297 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-5a272c5c-7f07-4de6-a948-139d0344adcd tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] 10.222.0.20 "GET /compute/v2.1/servers/6064b8b7-d821-4db1-86fa-c24015af68c7/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044859 Jul 05 21:00:42.932270 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 349/717] 10.222.0.20 () {58 vars in 1301 bytes} [Tue Jul 5 21:00:42 2022] GET /compute/v2.1/servers/6064b8b7-d821-4db1-86fa-c24015af68c7/os-volume_attachments => generated 371 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 21:00:43.071501 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-e920db31-9e5b-4dd4-9066-6fa9a7871f34 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 21:00:43.072019 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-e920db31-9e5b-4dd4-9066-6fa9a7871f34 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] [instance: 6064b8b7-d821-4db1-86fa-c24015af68c7] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 21:00:43.078795 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-e920db31-9e5b-4dd4-9066-6fa9a7871f34 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:00:43.079240 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-e920db31-9e5b-4dd4-9066-6fa9a7871f34 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:00:43.079989 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-e920db31-9e5b-4dd4-9066-6fa9a7871f34 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:00:43.080618 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-e920db31-9e5b-4dd4-9066-6fa9a7871f34 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:00:43.084971 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG dbcounter [-] [117628] Writing DB stats nova_cell1:SELECT=100 {{(pid=117628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:00:43.110985 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-e920db31-9e5b-4dd4-9066-6fa9a7871f34 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] 10.222.0.20 "GET /compute/v2.1/servers/6064b8b7-d821-4db1-86fa-c24015af68c7/os-volume_attachments/d91a8f85-64c9-4432-8de3-d780d44399c4" status: 200 len: 194 microversion: 2.1 time: 0.043862 Jul 05 21:00:43.111565 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 369/718] 10.222.0.20 () {58 vars in 1412 bytes} [Tue Jul 5 21:00:43 2022] GET /compute/v2.1/servers/6064b8b7-d821-4db1-86fa-c24015af68c7/os-volume_attachments/d91a8f85-64c9-4432-8de3-d780d44399c4 => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 21:00:43.121504 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-c484bf2d-f5da-48e8-a02f-4b6976d49c93 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 21:00:43.121994 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-c484bf2d-f5da-48e8-a02f-4b6976d49c93 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] [instance: 6064b8b7-d821-4db1-86fa-c24015af68c7] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 21:00:43.128834 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-c484bf2d-f5da-48e8-a02f-4b6976d49c93 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:00:43.129450 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-c484bf2d-f5da-48e8-a02f-4b6976d49c93 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:00:43.130340 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-c484bf2d-f5da-48e8-a02f-4b6976d49c93 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:00:43.130767 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-c484bf2d-f5da-48e8-a02f-4b6976d49c93 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:00:43.135097 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG dbcounter [-] [117627] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=117627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:00:43.215452 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.objects.instance [None req-c484bf2d-f5da-48e8-a02f-4b6976d49c93 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lazy-loading 'services' on Instance uuid 6064b8b7-d821-4db1-86fa-c24015af68c7 {{(pid=117627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 05 21:00:43.291279 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-c484bf2d-f5da-48e8-a02f-4b6976d49c93 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] 10.222.0.20 "DELETE /compute/v2.1/servers/6064b8b7-d821-4db1-86fa-c24015af68c7/os-volume_attachments/d91a8f85-64c9-4432-8de3-d780d44399c4" status: 202 len: 0 microversion: 2.1 time: 0.173673 Jul 05 21:00:43.292144 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 350/719] 10.222.0.20 () {58 vars in 1415 bytes} [Tue Jul 5 21:00:43 2022] DELETE /compute/v2.1/servers/6064b8b7-d821-4db1-86fa-c24015af68c7/os-volume_attachments/d91a8f85-64c9-4432-8de3-d780d44399c4 => generated 0 bytes in 175 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 05 21:00:45.461281 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-0461ccb6-77aa-44e6-9387-88850686ba94 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 21:00:45.461775 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-0461ccb6-77aa-44e6-9387-88850686ba94 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] [instance: 6064b8b7-d821-4db1-86fa-c24015af68c7] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 21:00:45.468380 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-0461ccb6-77aa-44e6-9387-88850686ba94 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:00:45.468828 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-0461ccb6-77aa-44e6-9387-88850686ba94 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:00:45.469617 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-0461ccb6-77aa-44e6-9387-88850686ba94 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:00:45.470050 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-0461ccb6-77aa-44e6-9387-88850686ba94 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:00:45.497983 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-0461ccb6-77aa-44e6-9387-88850686ba94 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] 10.222.0.20 "GET /compute/v2.1/servers/6064b8b7-d821-4db1-86fa-c24015af68c7/os-volume_attachments/1d098fcf-f43c-4559-8b0a-0894708b8d24" status: 200 len: 194 microversion: 2.1 time: 0.041183 Jul 05 21:00:45.498534 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 370/720] 10.222.0.20 () {58 vars in 1412 bytes} [Tue Jul 5 21:00:45 2022] GET /compute/v2.1/servers/6064b8b7-d821-4db1-86fa-c24015af68c7/os-volume_attachments/1d098fcf-f43c-4559-8b0a-0894708b8d24 => generated 194 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 21:00:45.509345 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-730881e5-98a9-4ef8-8312-95fece32bae3 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 21:00:45.509946 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-730881e5-98a9-4ef8-8312-95fece32bae3 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] [instance: 6064b8b7-d821-4db1-86fa-c24015af68c7] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 21:00:45.516119 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-730881e5-98a9-4ef8-8312-95fece32bae3 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:00:45.516571 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-730881e5-98a9-4ef8-8312-95fece32bae3 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:00:45.517448 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-730881e5-98a9-4ef8-8312-95fece32bae3 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:00:45.517888 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-730881e5-98a9-4ef8-8312-95fece32bae3 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:00:45.603173 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.objects.instance [None req-730881e5-98a9-4ef8-8312-95fece32bae3 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lazy-loading 'services' on Instance uuid 6064b8b7-d821-4db1-86fa-c24015af68c7 {{(pid=117627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 05 21:00:45.673050 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-730881e5-98a9-4ef8-8312-95fece32bae3 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] 10.222.0.20 "DELETE /compute/v2.1/servers/6064b8b7-d821-4db1-86fa-c24015af68c7/os-volume_attachments/1d098fcf-f43c-4559-8b0a-0894708b8d24" status: 202 len: 0 microversion: 2.1 time: 0.168439 Jul 05 21:00:45.673584 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 351/721] 10.222.0.20 () {58 vars in 1415 bytes} [Tue Jul 5 21:00:45 2022] DELETE /compute/v2.1/servers/6064b8b7-d821-4db1-86fa-c24015af68c7/os-volume_attachments/1d098fcf-f43c-4559-8b0a-0894708b8d24 => generated 0 bytes in 170 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 05 21:00:46.828923 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-1b8de4bc-42a0-4134-9cf9-e7cd0999adcb tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 21:00:46.829875 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-1b8de4bc-42a0-4134-9cf9-e7cd0999adcb tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] [instance: 6064b8b7-d821-4db1-86fa-c24015af68c7] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 21:00:46.837200 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-1b8de4bc-42a0-4134-9cf9-e7cd0999adcb tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:00:46.837651 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-1b8de4bc-42a0-4134-9cf9-e7cd0999adcb tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:00:46.838415 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-1b8de4bc-42a0-4134-9cf9-e7cd0999adcb tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:00:46.838857 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-1b8de4bc-42a0-4134-9cf9-e7cd0999adcb tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:00:46.869375 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-1b8de4bc-42a0-4134-9cf9-e7cd0999adcb tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] 10.222.0.20 "GET /compute/v2.1/servers/6064b8b7-d821-4db1-86fa-c24015af68c7/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044286 Jul 05 21:00:46.870153 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 371/722] 10.222.0.20 () {58 vars in 1301 bytes} [Tue Jul 5 21:00:46 2022] GET /compute/v2.1/servers/6064b8b7-d821-4db1-86fa-c24015af68c7/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 05 21:00:46.977506 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-28bda4f4-3b6e-4972-8e62-574f602c3ee5 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 21:00:46.978510 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-28bda4f4-3b6e-4972-8e62-574f602c3ee5 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] [instance: 6064b8b7-d821-4db1-86fa-c24015af68c7] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 21:00:46.984700 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-28bda4f4-3b6e-4972-8e62-574f602c3ee5 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:00:46.985190 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-28bda4f4-3b6e-4972-8e62-574f602c3ee5 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:00:46.985953 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-28bda4f4-3b6e-4972-8e62-574f602c3ee5 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:00:46.986446 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-28bda4f4-3b6e-4972-8e62-574f602c3ee5 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:00:47.016545 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-28bda4f4-3b6e-4972-8e62-574f602c3ee5 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] 10.222.0.20 "GET /compute/v2.1/servers/6064b8b7-d821-4db1-86fa-c24015af68c7/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044005 Jul 05 21:00:47.017141 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 352/723] 10.222.0.20 () {58 vars in 1301 bytes} [Tue Jul 5 21:00:46 2022] GET /compute/v2.1/servers/6064b8b7-d821-4db1-86fa-c24015af68c7/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 05 21:00:47.075323 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-ab795950-3ee7-4105-bd6c-df599397793d tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 21:00:47.075818 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-ab795950-3ee7-4105-bd6c-df599397793d tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] [instance: 6064b8b7-d821-4db1-86fa-c24015af68c7] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 21:00:47.081967 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-ab795950-3ee7-4105-bd6c-df599397793d tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:00:47.082418 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-ab795950-3ee7-4105-bd6c-df599397793d tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:00:47.083168 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-ab795950-3ee7-4105-bd6c-df599397793d tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:00:47.083604 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-ab795950-3ee7-4105-bd6c-df599397793d tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:00:47.110328 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-ab795950-3ee7-4105-bd6c-df599397793d tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] [instance: 6064b8b7-d821-4db1-86fa-c24015af68c7] Going to try to terminate instance {{(pid=117628) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 05 21:00:47.192048 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-ab795950-3ee7-4105-bd6c-df599397793d tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] 10.222.0.20 "DELETE /compute/v2.1/servers/6064b8b7-d821-4db1-86fa-c24015af68c7" status: 204 len: 0 microversion: 2.1 time: 0.119246 Jul 05 21:00:47.194001 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 372/724] 10.222.0.20 () {58 vars in 1238 bytes} [Tue Jul 5 21:00:47 2022] DELETE /compute/v2.1/servers/6064b8b7-d821-4db1-86fa-c24015af68c7 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 05 21:00:47.202123 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-611d77c8-6db5-4e28-b49a-3ad848bccea5 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 21:00:47.202738 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-611d77c8-6db5-4e28-b49a-3ad848bccea5 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] [instance: 6064b8b7-d821-4db1-86fa-c24015af68c7] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 21:00:47.211122 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-611d77c8-6db5-4e28-b49a-3ad848bccea5 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:00:47.211788 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-611d77c8-6db5-4e28-b49a-3ad848bccea5 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:00:47.213055 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-611d77c8-6db5-4e28-b49a-3ad848bccea5 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:00:47.213636 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-611d77c8-6db5-4e28-b49a-3ad848bccea5 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:00:47.397664 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-611d77c8-6db5-4e28-b49a-3ad848bccea5 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eac41ce3f04450b840cff305ec1a5ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47e1ad014d542f98f6b24c8a504d166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 21:00:47.405450 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-611d77c8-6db5-4e28-b49a-3ad848bccea5 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] 10.222.0.20 "GET /compute/v2.1/servers/6064b8b7-d821-4db1-86fa-c24015af68c7" status: 200 len: 1673 microversion: 2.1 time: 0.207130 Jul 05 21:00:47.406018 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 353/725] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 21:00:47 2022] GET /compute/v2.1/servers/6064b8b7-d821-4db1-86fa-c24015af68c7 => generated 1673 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 21:00:48.423496 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-755dd7b5-151b-4204-994e-7ab04865abf9 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 21:00:48.424198 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-755dd7b5-151b-4204-994e-7ab04865abf9 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] [instance: 6064b8b7-d821-4db1-86fa-c24015af68c7] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 21:00:48.431087 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-755dd7b5-151b-4204-994e-7ab04865abf9 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:00:48.431530 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-755dd7b5-151b-4204-994e-7ab04865abf9 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:00:48.432286 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-755dd7b5-151b-4204-994e-7ab04865abf9 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:00:48.432864 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-755dd7b5-151b-4204-994e-7ab04865abf9 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:00:48.565419 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-755dd7b5-151b-4204-994e-7ab04865abf9 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eac41ce3f04450b840cff305ec1a5ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47e1ad014d542f98f6b24c8a504d166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 21:00:48.573575 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-755dd7b5-151b-4204-994e-7ab04865abf9 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] 10.222.0.20 "GET /compute/v2.1/servers/6064b8b7-d821-4db1-86fa-c24015af68c7" status: 200 len: 1673 microversion: 2.1 time: 0.154199 Jul 05 21:00:48.574323 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 373/726] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 21:00:48 2022] GET /compute/v2.1/servers/6064b8b7-d821-4db1-86fa-c24015af68c7 => generated 1673 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 21:00:49.590617 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-784d8df6-6c21-4581-852a-32729fc2243f tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 21:00:49.591229 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-784d8df6-6c21-4581-852a-32729fc2243f tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] [instance: 6064b8b7-d821-4db1-86fa-c24015af68c7] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 21:00:49.598143 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-784d8df6-6c21-4581-852a-32729fc2243f tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:00:49.598554 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-784d8df6-6c21-4581-852a-32729fc2243f tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:00:49.599320 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-784d8df6-6c21-4581-852a-32729fc2243f tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:00:49.599762 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-784d8df6-6c21-4581-852a-32729fc2243f tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:00:49.744979 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-784d8df6-6c21-4581-852a-32729fc2243f tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eac41ce3f04450b840cff305ec1a5ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47e1ad014d542f98f6b24c8a504d166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 21:00:49.753397 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-784d8df6-6c21-4581-852a-32729fc2243f tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] 10.222.0.20 "GET /compute/v2.1/servers/6064b8b7-d821-4db1-86fa-c24015af68c7" status: 200 len: 1673 microversion: 2.1 time: 0.166602 Jul 05 21:00:49.754625 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 354/727] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 21:00:49 2022] GET /compute/v2.1/servers/6064b8b7-d821-4db1-86fa-c24015af68c7 => generated 1673 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 21:00:49.793154 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-9098bda3-abfc-4356-a8cf-6578c4b66fc2 tempest-VolumesNegativeTest-773084915 tempest-VolumesNegativeTest-773084915-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1758335206", "imageRef": "88e08f49-c01d-4849-a89f-b678588e56f4", "flavorRef": "452"}} {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 21:00:49.847385 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.network.neutron [None req-9098bda3-abfc-4356-a8cf-6578c4b66fc2 tempest-VolumesNegativeTest-773084915 tempest-VolumesNegativeTest-773084915-project] validate_networks() for None {{(pid=117628) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 05 21:00:50.124995 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.virt.hardware [None req-9098bda3-abfc-4356-a8cf-6578c4b66fc2 tempest-VolumesNegativeTest-773084915 tempest-VolumesNegativeTest-773084915-project] Flavor limits 0:0:0 {{(pid=117628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 05 21:00:50.125419 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.virt.hardware [None req-9098bda3-abfc-4356-a8cf-6578c4b66fc2 tempest-VolumesNegativeTest-773084915 tempest-VolumesNegativeTest-773084915-project] Image limits 0:0:0 {{(pid=117628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 05 21:00:50.125920 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.virt.hardware [None req-9098bda3-abfc-4356-a8cf-6578c4b66fc2 tempest-VolumesNegativeTest-773084915 tempest-VolumesNegativeTest-773084915-project] Flavor pref 0:0:0 {{(pid=117628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 05 21:00:50.126321 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.virt.hardware [None req-9098bda3-abfc-4356-a8cf-6578c4b66fc2 tempest-VolumesNegativeTest-773084915 tempest-VolumesNegativeTest-773084915-project] Image pref 0:0:0 {{(pid=117628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 05 21:00:50.126731 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.virt.hardware [None req-9098bda3-abfc-4356-a8cf-6578c4b66fc2 tempest-VolumesNegativeTest-773084915 tempest-VolumesNegativeTest-773084915-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 05 21:00:50.136250 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-9098bda3-abfc-4356-a8cf-6578c4b66fc2 tempest-VolumesNegativeTest-773084915 tempest-VolumesNegativeTest-773084915-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:00:50.136614 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-9098bda3-abfc-4356-a8cf-6578c4b66fc2 tempest-VolumesNegativeTest-773084915 tempest-VolumesNegativeTest-773084915-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:00:50.137470 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-9098bda3-abfc-4356-a8cf-6578c4b66fc2 tempest-VolumesNegativeTest-773084915 tempest-VolumesNegativeTest-773084915-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:00:50.137902 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-9098bda3-abfc-4356-a8cf-6578c4b66fc2 tempest-VolumesNegativeTest-773084915 tempest-VolumesNegativeTest-773084915-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:00:50.160166 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.quota [None req-9098bda3-abfc-4356-a8cf-6578c4b66fc2 tempest-VolumesNegativeTest-773084915 tempest-VolumesNegativeTest-773084915-project] Getting quotas for project 983b3f0a085c45508d9a90a1b636a142. Resources: {'cores', 'ram', 'instances'} {{(pid=117628) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 05 21:00:50.164779 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.quota [None req-9098bda3-abfc-4356-a8cf-6578c4b66fc2 tempest-VolumesNegativeTest-773084915 tempest-VolumesNegativeTest-773084915-project] Getting quotas for user 8b26cb0743ba46809d9a9f414ae7555c and project 983b3f0a085c45508d9a90a1b636a142. Resources: {'cores', 'ram', 'instances'} {{(pid=117628) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 05 21:00:50.176779 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-9098bda3-abfc-4356-a8cf-6578c4b66fc2 tempest-VolumesNegativeTest-773084915 tempest-VolumesNegativeTest-773084915-project] Going to run 1 instances... {{(pid=117628) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 05 21:00:50.179196 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-9098bda3-abfc-4356-a8cf-6578c4b66fc2 tempest-VolumesNegativeTest-773084915 tempest-VolumesNegativeTest-773084915-project] [instance: d214d3a1-82b9-446d-b3b7-5dbc90544bee] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='88e08f49-c01d-4849-a89f-b678588e56f4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117628) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 05 21:00:50.225315 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-9098bda3-abfc-4356-a8cf-6578c4b66fc2 tempest-VolumesNegativeTest-773084915 tempest-VolumesNegativeTest-773084915-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.435688 Jul 05 21:00:50.226058 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 374/728] 10.222.0.20 () {60 vars in 1146 bytes} [Tue Jul 5 21:00:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 437 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 05 21:00:50.236043 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-c8aad2c0-feba-4aa3-b561-5b87b1de19a2 tempest-VolumesNegativeTest-773084915 tempest-VolumesNegativeTest-773084915-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 21:00:50.236670 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-c8aad2c0-feba-4aa3-b561-5b87b1de19a2 tempest-VolumesNegativeTest-773084915 tempest-VolumesNegativeTest-773084915-project] [instance: d214d3a1-82b9-446d-b3b7-5dbc90544bee] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 21:00:50.302800 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-c8aad2c0-feba-4aa3-b561-5b87b1de19a2 tempest-VolumesNegativeTest-773084915 tempest-VolumesNegativeTest-773084915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b26cb0743ba46809d9a9f414ae7555c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '983b3f0a085c45508d9a90a1b636a142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 21:00:50.310361 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-c8aad2c0-feba-4aa3-b561-5b87b1de19a2 tempest-VolumesNegativeTest-773084915 tempest-VolumesNegativeTest-773084915-project] 10.222.0.20 "GET /compute/v2.1/servers/d214d3a1-82b9-446d-b3b7-5dbc90544bee" status: 200 len: 1215 microversion: 2.1 time: 0.078271 Jul 05 21:00:50.311941 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 355/729] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 21:00:50 2022] GET /compute/v2.1/servers/d214d3a1-82b9-446d-b3b7-5dbc90544bee => generated 1215 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 21:00:50.646625 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [req-fcf4111f-d577-4901-a8a1-7c7d2be02292 req-2c963a13-0af2-407f-be6f-0e740b430310 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6064b8b7-d821-4db1-86fa-c24015af68c7", "name": "network-vif-deleted", "tag": "e4577f63-e157-4dcd-b061-03b9dd87e83a"}]} {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 21:00:50.662737 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [req-fcf4111f-d577-4901-a8a1-7c7d2be02292 req-2c963a13-0af2-407f-be6f-0e740b430310 service nova] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:00:50.663196 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [req-fcf4111f-d577-4901-a8a1-7c7d2be02292 req-2c963a13-0af2-407f-be6f-0e740b430310 service nova] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:00:50.677617 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.compute.server_external_events [req-fcf4111f-d577-4901-a8a1-7c7d2be02292 req-2c963a13-0af2-407f-be6f-0e740b430310 service nova] Creating event network-vif-deleted:e4577f63-e157-4dcd-b061-03b9dd87e83a for instance 6064b8b7-d821-4db1-86fa-c24015af68c7 on hv-cinder-79760 Jul 05 21:00:50.683126 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [req-fcf4111f-d577-4901-a8a1-7c7d2be02292 req-2c963a13-0af2-407f-be6f-0e740b430310 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.216427 Jul 05 21:00:50.683977 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 375/730] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 5 21:00:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 21:00:50.772595 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-17f2c8a8-7788-41e7-bfb5-0df4ed5b8212 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 21:00:50.773576 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-17f2c8a8-7788-41e7-bfb5-0df4ed5b8212 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] [instance: 6064b8b7-d821-4db1-86fa-c24015af68c7] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 21:00:50.780681 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-17f2c8a8-7788-41e7-bfb5-0df4ed5b8212 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:00:50.781161 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-17f2c8a8-7788-41e7-bfb5-0df4ed5b8212 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:00:50.781934 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-17f2c8a8-7788-41e7-bfb5-0df4ed5b8212 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:00:50.782369 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-17f2c8a8-7788-41e7-bfb5-0df4ed5b8212 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:00:50.818391 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-17f2c8a8-7788-41e7-bfb5-0df4ed5b8212 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:00:50.818845 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-17f2c8a8-7788-41e7-bfb5-0df4ed5b8212 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:00:50.819292 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.objects.instance [None req-17f2c8a8-7788-41e7-bfb5-0df4ed5b8212 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lazy-loading 'fault' on Instance uuid 6064b8b7-d821-4db1-86fa-c24015af68c7 {{(pid=117627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 05 21:00:50.860695 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-17f2c8a8-7788-41e7-bfb5-0df4ed5b8212 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eac41ce3f04450b840cff305ec1a5ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47e1ad014d542f98f6b24c8a504d166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 21:00:50.868922 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-17f2c8a8-7788-41e7-bfb5-0df4ed5b8212 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] 10.222.0.20 "GET /compute/v2.1/servers/6064b8b7-d821-4db1-86fa-c24015af68c7" status: 200 len: 1327 microversion: 2.1 time: 0.101328 Jul 05 21:00:50.869514 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 356/731] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 21:00:50 2022] GET /compute/v2.1/servers/6064b8b7-d821-4db1-86fa-c24015af68c7 => generated 1327 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 21:00:51.330379 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-c62313b7-a3e1-44c2-82e5-8678d480a28d tempest-VolumesNegativeTest-773084915 tempest-VolumesNegativeTest-773084915-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 21:00:51.331066 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-c62313b7-a3e1-44c2-82e5-8678d480a28d tempest-VolumesNegativeTest-773084915 tempest-VolumesNegativeTest-773084915-project] [instance: d214d3a1-82b9-446d-b3b7-5dbc90544bee] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 21:00:51.337623 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-c62313b7-a3e1-44c2-82e5-8678d480a28d tempest-VolumesNegativeTest-773084915 tempest-VolumesNegativeTest-773084915-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:00:51.338064 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-c62313b7-a3e1-44c2-82e5-8678d480a28d tempest-VolumesNegativeTest-773084915 tempest-VolumesNegativeTest-773084915-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:00:51.338819 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-c62313b7-a3e1-44c2-82e5-8678d480a28d tempest-VolumesNegativeTest-773084915 tempest-VolumesNegativeTest-773084915-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:00:51.339243 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-c62313b7-a3e1-44c2-82e5-8678d480a28d tempest-VolumesNegativeTest-773084915 tempest-VolumesNegativeTest-773084915-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:00:51.402691 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-c62313b7-a3e1-44c2-82e5-8678d480a28d tempest-VolumesNegativeTest-773084915 tempest-VolumesNegativeTest-773084915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b26cb0743ba46809d9a9f414ae7555c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '983b3f0a085c45508d9a90a1b636a142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 21:00:51.410573 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-c62313b7-a3e1-44c2-82e5-8678d480a28d tempest-VolumesNegativeTest-773084915 tempest-VolumesNegativeTest-773084915-project] 10.222.0.20 "GET /compute/v2.1/servers/d214d3a1-82b9-446d-b3b7-5dbc90544bee" status: 200 len: 1267 microversion: 2.1 time: 0.084811 Jul 05 21:00:51.411156 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 376/732] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 21:00:51 2022] GET /compute/v2.1/servers/d214d3a1-82b9-446d-b3b7-5dbc90544bee => generated 1267 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 21:00:51.886022 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-0375b135-cb2c-4242-9a84-ef24c8d82a65 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 21:00:51.886641 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-0375b135-cb2c-4242-9a84-ef24c8d82a65 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] [instance: 6064b8b7-d821-4db1-86fa-c24015af68c7] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 21:00:51.893153 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-0375b135-cb2c-4242-9a84-ef24c8d82a65 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:00:51.893604 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-0375b135-cb2c-4242-9a84-ef24c8d82a65 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:00:51.895216 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-0375b135-cb2c-4242-9a84-ef24c8d82a65 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:00:51.895651 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-0375b135-cb2c-4242-9a84-ef24c8d82a65 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:00:51.908868 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.wsgi [None req-0375b135-cb2c-4242-9a84-ef24c8d82a65 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] HTTP exception thrown: Instance 6064b8b7-d821-4db1-86fa-c24015af68c7 could not be found. Jul 05 21:00:51.910626 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-0375b135-cb2c-4242-9a84-ef24c8d82a65 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Request method failure captured: Jul 05 21:00:51.910626 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: request: GET /compute/v2.1/servers/6064b8b7-d821-4db1-86fa-c24015af68c7 HTTP/1.1 Jul 05 21:00:51.910626 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: Accept: application/json Jul 05 21:00:51.910626 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: Accept-Encoding: identity Jul 05 21:00:51.910626 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: Connection: close Jul 05 21:00:51.910626 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: Content-Length: 0 Jul 05 21:00:51.910626 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: Content-Type: application/json Jul 05 21:00:51.910626 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: Host: 10.222.0.20 Jul 05 21:00:51.910626 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: Openstack-System-Scope: None Jul 05 21:00:51.910626 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: User-Agent: python-urllib3/1.26.9 Jul 05 21:00:51.910626 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Auth-Token: gAAAAABixKUH4B5j0zEKvinNFBojvLuZ2PCmMo7rFpX95lsIdciwUpaZiEjJqc2l7qkZUkg05gnf1DMkOon_2FSnNiTU4Un89EcTxDLACWDM3hYnFg_2VDZ7GVK518HYK24njE8pU7e7WNMFX96QTUmXce3fdv9VwGLE0AsaMMcaWY3KTSQ4MzU Jul 05 21:00:51.910626 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Domain-Id: None Jul 05 21:00:51.910626 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Domain-Name: None Jul 05 21:00:51.910626 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Identity-Status: Confirmed Jul 05 21:00:51.910626 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Is-Admin-Project: True Jul 05 21:00:51.910626 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Project-Domain-Id: default Jul 05 21:00:51.910626 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Project-Domain-Name: Default Jul 05 21:00:51.910626 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Project-Id: c47e1ad014d542f98f6b24c8a504d166 Jul 05 21:00:51.910626 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Project-Name: tempest-AttachVolumeTestJSON-2080646407 Jul 05 21:00:51.910626 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Role: member,reader Jul 05 21:00:51.910626 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Roles: member,reader Jul 05 21:00:51.912255 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c47e1ad014d542f98f6b24c8a504d166"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/c47e1ad014d542f98f6b24c8a504d166"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_c47e1ad014d542f98f6b24c8a504d166"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c47e1ad014d542f98f6b24c8a504d166"}]}] Jul 05 21:00:51.912255 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Tenant: tempest-AttachVolumeTestJSON-2080646407 Jul 05 21:00:51.912255 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Tenant-Id: c47e1ad014d542f98f6b24c8a504d166 Jul 05 21:00:51.912255 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2080646407 Jul 05 21:00:51.912255 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-User: tempest-AttachVolumeTestJSON-2080646407-project Jul 05 21:00:51.912255 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-User-Domain-Id: default Jul 05 21:00:51.912255 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-User-Domain-Name: Default Jul 05 21:00:51.912255 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-User-Id: 5eac41ce3f04450b840cff305ec1a5ac Jul 05 21:00:51.912255 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-User-Name: tempest-AttachVolumeTestJSON-2080646407-project Jul 05 21:00:51.912255 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: method: > Jul 05 21:00:51.912255 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: exception: Instance 6064b8b7-d821-4db1-86fa-c24015af68c7 could not be found. Jul 05 21:00:51.912255 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: action_args: {'id': '6064b8b7-d821-4db1-86fa-c24015af68c7'} Jul 05 21:00:51.913302 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 05 21:00:51.913302 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 21:00:51.913302 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 05 21:00:51.913302 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 05 21:00:51.913302 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 05 21:00:51.913302 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 05 21:00:51.913302 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 05 21:00:51.913302 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 05 21:00:51.913302 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 05 21:00:51.913302 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 05 21:00:51.913302 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6064b8b7-d821-4db1-86fa-c24015af68c7 could not be found. Jul 05 21:00:51.913302 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi Jul 05 21:00:51.913302 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 21:00:51.913302 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi Jul 05 21:00:51.913302 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 21:00:51.913302 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 21:00:51.913302 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 21:00:51.913302 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 05 21:00:51.913302 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 05 21:00:51.913302 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 05 21:00:51.914850 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 05 21:00:51.914850 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 05 21:00:51.914850 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 05 21:00:51.914850 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 05 21:00:51.914850 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 05 21:00:51.914850 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 05 21:00:51.914850 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 05 21:00:51.914850 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6064b8b7-d821-4db1-86fa-c24015af68c7 could not be found. Jul 05 21:00:51.914850 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi Jul 05 21:00:51.914850 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 21:00:51.914850 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi Jul 05 21:00:51.914850 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 21:00:51.914850 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 21:00:51.914850 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 21:00:51.914850 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 05 21:00:51.914850 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 05 21:00:51.914850 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6064b8b7-d821-4db1-86fa-c24015af68c7 could not be found. Jul 05 21:00:51.914850 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi Jul 05 21:00:51.916306 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-0375b135-cb2c-4242-9a84-ef24c8d82a65 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Returning 404 to user: Instance 6064b8b7-d821-4db1-86fa-c24015af68c7 could not be found. {{(pid=117627) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 05 21:00:51.916306 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-0375b135-cb2c-4242-9a84-ef24c8d82a65 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] 10.222.0.20 "GET /compute/v2.1/servers/6064b8b7-d821-4db1-86fa-c24015af68c7" status: 404 len: 111 microversion: 2.1 time: 0.029839 Jul 05 21:00:51.916306 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 357/733] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 21:00:51 2022] GET /compute/v2.1/servers/6064b8b7-d821-4db1-86fa-c24015af68c7 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 05 21:00:51.920900 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-13ead5a9-b20f-4f26-b787-e37f2f14cd10 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Calling method '.version_select at 0x7f57cdf6b430>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 21:00:51.939958 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-13ead5a9-b20f-4f26-b787-e37f2f14cd10 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-676421919" status: 202 len: 0 microversion: 2.1 time: 0.022786 Jul 05 21:00:51.940570 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 377/734] 10.222.0.20 () {58 vars in 1217 bytes} [Tue Jul 5 21:00:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-676421919 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 05 21:00:52.428268 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-f2cdaa4b-1fa4-413e-8d70-2cfd6ff12754 tempest-VolumesNegativeTest-773084915 tempest-VolumesNegativeTest-773084915-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 21:00:52.428785 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-f2cdaa4b-1fa4-413e-8d70-2cfd6ff12754 tempest-VolumesNegativeTest-773084915 tempest-VolumesNegativeTest-773084915-project] [instance: d214d3a1-82b9-446d-b3b7-5dbc90544bee] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 21:00:52.434863 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-f2cdaa4b-1fa4-413e-8d70-2cfd6ff12754 tempest-VolumesNegativeTest-773084915 tempest-VolumesNegativeTest-773084915-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:00:52.435316 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-f2cdaa4b-1fa4-413e-8d70-2cfd6ff12754 tempest-VolumesNegativeTest-773084915 tempest-VolumesNegativeTest-773084915-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:00:52.436087 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-f2cdaa4b-1fa4-413e-8d70-2cfd6ff12754 tempest-VolumesNegativeTest-773084915 tempest-VolumesNegativeTest-773084915-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:00:52.436526 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-f2cdaa4b-1fa4-413e-8d70-2cfd6ff12754 tempest-VolumesNegativeTest-773084915 tempest-VolumesNegativeTest-773084915-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:00:52.529660 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-f2cdaa4b-1fa4-413e-8d70-2cfd6ff12754 tempest-VolumesNegativeTest-773084915 tempest-VolumesNegativeTest-773084915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b26cb0743ba46809d9a9f414ae7555c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '983b3f0a085c45508d9a90a1b636a142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 21:00:52.539826 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-f2cdaa4b-1fa4-413e-8d70-2cfd6ff12754 tempest-VolumesNegativeTest-773084915 tempest-VolumesNegativeTest-773084915-project] 10.222.0.20 "GET /compute/v2.1/servers/d214d3a1-82b9-446d-b3b7-5dbc90544bee" status: 200 len: 1273 microversion: 2.1 time: 0.116037 Jul 05 21:00:52.540627 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 358/735] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 21:00:52 2022] GET /compute/v2.1/servers/d214d3a1-82b9-446d-b3b7-5dbc90544bee => generated 1273 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 21:00:53.288975 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [req-530b697d-0b7c-449b-af38-d714d581c9cc req-6f61a811-1cba-4560-9446-6b2122d1d47f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d214d3a1-82b9-446d-b3b7-5dbc90544bee", "tag": "8d2908ef-7443-45fc-983f-d7e1c1eb447f"}]} {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 21:00:53.315571 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [req-530b697d-0b7c-449b-af38-d714d581c9cc req-6f61a811-1cba-4560-9446-6b2122d1d47f service nova] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:00:53.316367 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [req-530b697d-0b7c-449b-af38-d714d581c9cc req-6f61a811-1cba-4560-9446-6b2122d1d47f service nova] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:00:53.328714 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.compute.server_external_events [req-530b697d-0b7c-449b-af38-d714d581c9cc req-6f61a811-1cba-4560-9446-6b2122d1d47f service nova] Creating event network-changed:8d2908ef-7443-45fc-983f-d7e1c1eb447f for instance d214d3a1-82b9-446d-b3b7-5dbc90544bee on hv-cinder-79760 Jul 05 21:00:53.334142 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [req-530b697d-0b7c-449b-af38-d714d581c9cc req-6f61a811-1cba-4560-9446-6b2122d1d47f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055194 Jul 05 21:00:53.334744 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 378/736] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 5 21:00:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 21:00:53.557065 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-4bd176c3-85e8-4881-ac48-6c15587a7a84 tempest-VolumesNegativeTest-773084915 tempest-VolumesNegativeTest-773084915-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 21:00:53.557739 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-4bd176c3-85e8-4881-ac48-6c15587a7a84 tempest-VolumesNegativeTest-773084915 tempest-VolumesNegativeTest-773084915-project] [instance: d214d3a1-82b9-446d-b3b7-5dbc90544bee] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 21:00:53.564231 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-4bd176c3-85e8-4881-ac48-6c15587a7a84 tempest-VolumesNegativeTest-773084915 tempest-VolumesNegativeTest-773084915-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:00:53.564693 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-4bd176c3-85e8-4881-ac48-6c15587a7a84 tempest-VolumesNegativeTest-773084915 tempest-VolumesNegativeTest-773084915-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:00:53.565494 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-4bd176c3-85e8-4881-ac48-6c15587a7a84 tempest-VolumesNegativeTest-773084915 tempest-VolumesNegativeTest-773084915-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:00:53.565955 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-4bd176c3-85e8-4881-ac48-6c15587a7a84 tempest-VolumesNegativeTest-773084915 tempest-VolumesNegativeTest-773084915-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:00:53.703417 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-4bd176c3-85e8-4881-ac48-6c15587a7a84 tempest-VolumesNegativeTest-773084915 tempest-VolumesNegativeTest-773084915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b26cb0743ba46809d9a9f414ae7555c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '983b3f0a085c45508d9a90a1b636a142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 21:00:53.712312 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-4bd176c3-85e8-4881-ac48-6c15587a7a84 tempest-VolumesNegativeTest-773084915 tempest-VolumesNegativeTest-773084915-project] 10.222.0.20 "GET /compute/v2.1/servers/d214d3a1-82b9-446d-b3b7-5dbc90544bee" status: 200 len: 1315 microversion: 2.1 time: 0.158995 Jul 05 21:00:53.712806 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 359/737] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 21:00:53 2022] GET /compute/v2.1/servers/d214d3a1-82b9-446d-b3b7-5dbc90544bee => generated 1315 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 21:00:54.729805 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-3f0f8abc-172d-4a2e-95b1-1a1e7e49c0d9 tempest-VolumesNegativeTest-773084915 tempest-VolumesNegativeTest-773084915-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 21:00:54.730503 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-3f0f8abc-172d-4a2e-95b1-1a1e7e49c0d9 tempest-VolumesNegativeTest-773084915 tempest-VolumesNegativeTest-773084915-project] [instance: d214d3a1-82b9-446d-b3b7-5dbc90544bee] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 21:00:54.736657 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-3f0f8abc-172d-4a2e-95b1-1a1e7e49c0d9 tempest-VolumesNegativeTest-773084915 tempest-VolumesNegativeTest-773084915-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:00:54.737137 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-3f0f8abc-172d-4a2e-95b1-1a1e7e49c0d9 tempest-VolumesNegativeTest-773084915 tempest-VolumesNegativeTest-773084915-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:00:54.737912 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-3f0f8abc-172d-4a2e-95b1-1a1e7e49c0d9 tempest-VolumesNegativeTest-773084915 tempest-VolumesNegativeTest-773084915-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:00:54.738343 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-3f0f8abc-172d-4a2e-95b1-1a1e7e49c0d9 tempest-VolumesNegativeTest-773084915 tempest-VolumesNegativeTest-773084915-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:00:54.891103 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-3f0f8abc-172d-4a2e-95b1-1a1e7e49c0d9 tempest-VolumesNegativeTest-773084915 tempest-VolumesNegativeTest-773084915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b26cb0743ba46809d9a9f414ae7555c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '983b3f0a085c45508d9a90a1b636a142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 21:00:54.900149 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-3f0f8abc-172d-4a2e-95b1-1a1e7e49c0d9 tempest-VolumesNegativeTest-773084915 tempest-VolumesNegativeTest-773084915-project] 10.222.0.20 "GET /compute/v2.1/servers/d214d3a1-82b9-446d-b3b7-5dbc90544bee" status: 200 len: 1315 microversion: 2.1 time: 0.175052 Jul 05 21:00:54.912137 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 379/738] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 21:00:54 2022] GET /compute/v2.1/servers/d214d3a1-82b9-446d-b3b7-5dbc90544bee => generated 1315 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 21:00:54.912342 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-e9b1516e-1b29-4837-893d-28e0ebab0e05 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 21:00:54.912342 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-e9b1516e-1b29-4837-893d-28e0ebab0e05 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] [instance: 6064b8b7-d821-4db1-86fa-c24015af68c7] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 21:00:54.918035 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-e9b1516e-1b29-4837-893d-28e0ebab0e05 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:00:54.918496 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-e9b1516e-1b29-4837-893d-28e0ebab0e05 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:00:54.919236 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-e9b1516e-1b29-4837-893d-28e0ebab0e05 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:00:54.919665 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-e9b1516e-1b29-4837-893d-28e0ebab0e05 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:00:54.933900 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.wsgi [None req-e9b1516e-1b29-4837-893d-28e0ebab0e05 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] HTTP exception thrown: Instance 6064b8b7-d821-4db1-86fa-c24015af68c7 could not be found. Jul 05 21:00:54.935579 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-e9b1516e-1b29-4837-893d-28e0ebab0e05 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Request method failure captured: Jul 05 21:00:54.935579 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: request: DELETE /compute/v2.1/servers/6064b8b7-d821-4db1-86fa-c24015af68c7 HTTP/1.1 Jul 05 21:00:54.935579 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: Accept: application/json Jul 05 21:00:54.935579 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: Accept-Encoding: identity Jul 05 21:00:54.935579 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: Connection: close Jul 05 21:00:54.935579 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: Content-Length: 0 Jul 05 21:00:54.935579 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: Content-Type: application/json Jul 05 21:00:54.935579 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: Host: 10.222.0.20 Jul 05 21:00:54.935579 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: Openstack-System-Scope: None Jul 05 21:00:54.935579 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: User-Agent: python-urllib3/1.26.9 Jul 05 21:00:54.935579 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Auth-Token: gAAAAABixKUH4B5j0zEKvinNFBojvLuZ2PCmMo7rFpX95lsIdciwUpaZiEjJqc2l7qkZUkg05gnf1DMkOon_2FSnNiTU4Un89EcTxDLACWDM3hYnFg_2VDZ7GVK518HYK24njE8pU7e7WNMFX96QTUmXce3fdv9VwGLE0AsaMMcaWY3KTSQ4MzU Jul 05 21:00:54.935579 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Domain-Id: None Jul 05 21:00:54.935579 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Domain-Name: None Jul 05 21:00:54.935579 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Identity-Status: Confirmed Jul 05 21:00:54.935579 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Is-Admin-Project: True Jul 05 21:00:54.935579 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Project-Domain-Id: default Jul 05 21:00:54.935579 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Project-Domain-Name: Default Jul 05 21:00:54.935579 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Project-Id: c47e1ad014d542f98f6b24c8a504d166 Jul 05 21:00:54.935579 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Project-Name: tempest-AttachVolumeTestJSON-2080646407 Jul 05 21:00:54.935579 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Role: member,reader Jul 05 21:00:54.935579 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Roles: member,reader Jul 05 21:00:54.937348 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c47e1ad014d542f98f6b24c8a504d166"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/c47e1ad014d542f98f6b24c8a504d166"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_c47e1ad014d542f98f6b24c8a504d166"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c47e1ad014d542f98f6b24c8a504d166"}]}] Jul 05 21:00:54.937348 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Tenant: tempest-AttachVolumeTestJSON-2080646407 Jul 05 21:00:54.937348 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Tenant-Id: c47e1ad014d542f98f6b24c8a504d166 Jul 05 21:00:54.937348 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2080646407 Jul 05 21:00:54.937348 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-User: tempest-AttachVolumeTestJSON-2080646407-project Jul 05 21:00:54.937348 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-User-Domain-Id: default Jul 05 21:00:54.937348 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-User-Domain-Name: Default Jul 05 21:00:54.937348 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-User-Id: 5eac41ce3f04450b840cff305ec1a5ac Jul 05 21:00:54.937348 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-User-Name: tempest-AttachVolumeTestJSON-2080646407-project Jul 05 21:00:54.937348 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: method: > Jul 05 21:00:54.937348 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: exception: Instance 6064b8b7-d821-4db1-86fa-c24015af68c7 could not be found. Jul 05 21:00:54.937348 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: action_args: {'id': '6064b8b7-d821-4db1-86fa-c24015af68c7'} Jul 05 21:00:54.938222 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 05 21:00:54.938222 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 21:00:54.938222 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 05 21:00:54.938222 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 05 21:00:54.938222 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 05 21:00:54.938222 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 05 21:00:54.938222 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 05 21:00:54.938222 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 05 21:00:54.938222 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 05 21:00:54.938222 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 05 21:00:54.938222 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6064b8b7-d821-4db1-86fa-c24015af68c7 could not be found. Jul 05 21:00:54.938222 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi Jul 05 21:00:54.938222 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 21:00:54.938222 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi Jul 05 21:00:54.938222 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 21:00:54.938222 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 21:00:54.938222 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 21:00:54.938222 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 05 21:00:54.938222 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 05 21:00:54.938222 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 05 21:00:54.939573 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 05 21:00:54.939573 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 05 21:00:54.939573 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 05 21:00:54.939573 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 05 21:00:54.939573 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 05 21:00:54.939573 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 05 21:00:54.939573 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 05 21:00:54.939573 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 05 21:00:54.939573 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 05 21:00:54.939573 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6064b8b7-d821-4db1-86fa-c24015af68c7 could not be found. Jul 05 21:00:54.939573 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi Jul 05 21:00:54.939573 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 21:00:54.939573 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi Jul 05 21:00:54.939573 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 21:00:54.939573 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 21:00:54.939573 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 21:00:54.939573 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 05 21:00:54.939573 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 05 21:00:54.939573 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6064b8b7-d821-4db1-86fa-c24015af68c7 could not be found. Jul 05 21:00:54.939573 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi Jul 05 21:00:54.941372 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-e9b1516e-1b29-4837-893d-28e0ebab0e05 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Returning 404 to user: Instance 6064b8b7-d821-4db1-86fa-c24015af68c7 could not be found. {{(pid=117627) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 05 21:00:54.941372 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-e9b1516e-1b29-4837-893d-28e0ebab0e05 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] 10.222.0.20 "DELETE /compute/v2.1/servers/6064b8b7-d821-4db1-86fa-c24015af68c7" status: 404 len: 111 microversion: 2.1 time: 0.032434 Jul 05 21:00:54.941372 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 360/739] 10.222.0.20 () {58 vars in 1238 bytes} [Tue Jul 5 21:00:54 2022] DELETE /compute/v2.1/servers/6064b8b7-d821-4db1-86fa-c24015af68c7 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 05 21:00:54.946216 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-cb20156b-7a95-490b-be17-560ec4f13af4 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 21:00:54.946844 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-cb20156b-7a95-490b-be17-560ec4f13af4 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] [instance: 6064b8b7-d821-4db1-86fa-c24015af68c7] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 21:00:54.953038 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-cb20156b-7a95-490b-be17-560ec4f13af4 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:00:54.953491 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-cb20156b-7a95-490b-be17-560ec4f13af4 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:00:54.954450 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-cb20156b-7a95-490b-be17-560ec4f13af4 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:00:54.954885 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-cb20156b-7a95-490b-be17-560ec4f13af4 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:00:54.971102 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.wsgi [None req-cb20156b-7a95-490b-be17-560ec4f13af4 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] HTTP exception thrown: Instance 6064b8b7-d821-4db1-86fa-c24015af68c7 could not be found. Jul 05 21:00:54.973002 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-cb20156b-7a95-490b-be17-560ec4f13af4 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Request method failure captured: Jul 05 21:00:54.973002 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: request: GET /compute/v2.1/servers/6064b8b7-d821-4db1-86fa-c24015af68c7 HTTP/1.1 Jul 05 21:00:54.973002 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: Accept: application/json Jul 05 21:00:54.973002 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: Accept-Encoding: identity Jul 05 21:00:54.973002 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: Connection: close Jul 05 21:00:54.973002 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: Content-Length: 0 Jul 05 21:00:54.973002 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: Content-Type: application/json Jul 05 21:00:54.973002 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: Host: 10.222.0.20 Jul 05 21:00:54.973002 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: Openstack-System-Scope: None Jul 05 21:00:54.973002 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: User-Agent: python-urllib3/1.26.9 Jul 05 21:00:54.973002 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Auth-Token: gAAAAABixKUH4B5j0zEKvinNFBojvLuZ2PCmMo7rFpX95lsIdciwUpaZiEjJqc2l7qkZUkg05gnf1DMkOon_2FSnNiTU4Un89EcTxDLACWDM3hYnFg_2VDZ7GVK518HYK24njE8pU7e7WNMFX96QTUmXce3fdv9VwGLE0AsaMMcaWY3KTSQ4MzU Jul 05 21:00:54.973002 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Domain-Id: None Jul 05 21:00:54.973002 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Domain-Name: None Jul 05 21:00:54.973002 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Identity-Status: Confirmed Jul 05 21:00:54.973002 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Is-Admin-Project: True Jul 05 21:00:54.973002 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Project-Domain-Id: default Jul 05 21:00:54.973002 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Project-Domain-Name: Default Jul 05 21:00:54.973002 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Project-Id: c47e1ad014d542f98f6b24c8a504d166 Jul 05 21:00:54.973002 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Project-Name: tempest-AttachVolumeTestJSON-2080646407 Jul 05 21:00:54.973002 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Role: member,reader Jul 05 21:00:54.973002 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Roles: member,reader Jul 05 21:00:54.974649 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c47e1ad014d542f98f6b24c8a504d166"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/c47e1ad014d542f98f6b24c8a504d166"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_c47e1ad014d542f98f6b24c8a504d166"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c47e1ad014d542f98f6b24c8a504d166"}]}] Jul 05 21:00:54.974649 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Tenant: tempest-AttachVolumeTestJSON-2080646407 Jul 05 21:00:54.974649 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Tenant-Id: c47e1ad014d542f98f6b24c8a504d166 Jul 05 21:00:54.974649 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2080646407 Jul 05 21:00:54.974649 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-User: tempest-AttachVolumeTestJSON-2080646407-project Jul 05 21:00:54.974649 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-User-Domain-Id: default Jul 05 21:00:54.974649 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-User-Domain-Name: Default Jul 05 21:00:54.974649 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-User-Id: 5eac41ce3f04450b840cff305ec1a5ac Jul 05 21:00:54.974649 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-User-Name: tempest-AttachVolumeTestJSON-2080646407-project Jul 05 21:00:54.974649 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: method: > Jul 05 21:00:54.974649 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: exception: Instance 6064b8b7-d821-4db1-86fa-c24015af68c7 could not be found. Jul 05 21:00:54.974649 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: action_args: {'id': '6064b8b7-d821-4db1-86fa-c24015af68c7'} Jul 05 21:00:54.975518 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 05 21:00:54.975518 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 21:00:54.975518 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 05 21:00:54.975518 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 05 21:00:54.975518 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 05 21:00:54.975518 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 05 21:00:54.975518 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 05 21:00:54.975518 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 05 21:00:54.975518 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 05 21:00:54.975518 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 05 21:00:54.975518 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6064b8b7-d821-4db1-86fa-c24015af68c7 could not be found. Jul 05 21:00:54.975518 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi Jul 05 21:00:54.975518 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 21:00:54.975518 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi Jul 05 21:00:54.975518 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 21:00:54.975518 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 21:00:54.975518 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 21:00:54.975518 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 05 21:00:54.975518 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 05 21:00:54.975518 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 05 21:00:54.976984 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 05 21:00:54.976984 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 05 21:00:54.976984 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 05 21:00:54.976984 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 05 21:00:54.976984 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 05 21:00:54.976984 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 05 21:00:54.976984 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 05 21:00:54.976984 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6064b8b7-d821-4db1-86fa-c24015af68c7 could not be found. Jul 05 21:00:54.976984 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi Jul 05 21:00:54.976984 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 21:00:54.976984 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi Jul 05 21:00:54.976984 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 21:00:54.976984 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 21:00:54.976984 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 21:00:54.976984 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 05 21:00:54.976984 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 05 21:00:54.976984 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6064b8b7-d821-4db1-86fa-c24015af68c7 could not be found. Jul 05 21:00:54.976984 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi Jul 05 21:00:54.978293 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-cb20156b-7a95-490b-be17-560ec4f13af4 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Returning 404 to user: Instance 6064b8b7-d821-4db1-86fa-c24015af68c7 could not be found. {{(pid=117628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 05 21:00:54.978293 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-cb20156b-7a95-490b-be17-560ec4f13af4 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] 10.222.0.20 "GET /compute/v2.1/servers/6064b8b7-d821-4db1-86fa-c24015af68c7" status: 404 len: 111 microversion: 2.1 time: 0.032226 Jul 05 21:00:54.978293 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 380/740] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 21:00:54 2022] GET /compute/v2.1/servers/6064b8b7-d821-4db1-86fa-c24015af68c7 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 05 21:00:55.919741 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-5459f59c-7aee-47da-8b14-dac715193914 tempest-VolumesNegativeTest-773084915 tempest-VolumesNegativeTest-773084915-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 21:00:55.920371 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-5459f59c-7aee-47da-8b14-dac715193914 tempest-VolumesNegativeTest-773084915 tempest-VolumesNegativeTest-773084915-project] [instance: d214d3a1-82b9-446d-b3b7-5dbc90544bee] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 21:00:55.927445 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-5459f59c-7aee-47da-8b14-dac715193914 tempest-VolumesNegativeTest-773084915 tempest-VolumesNegativeTest-773084915-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:00:55.927885 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-5459f59c-7aee-47da-8b14-dac715193914 tempest-VolumesNegativeTest-773084915 tempest-VolumesNegativeTest-773084915-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:00:55.928651 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-5459f59c-7aee-47da-8b14-dac715193914 tempest-VolumesNegativeTest-773084915 tempest-VolumesNegativeTest-773084915-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:00:55.929116 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-5459f59c-7aee-47da-8b14-dac715193914 tempest-VolumesNegativeTest-773084915 tempest-VolumesNegativeTest-773084915-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:00:56.079571 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-5459f59c-7aee-47da-8b14-dac715193914 tempest-VolumesNegativeTest-773084915 tempest-VolumesNegativeTest-773084915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b26cb0743ba46809d9a9f414ae7555c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '983b3f0a085c45508d9a90a1b636a142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 21:00:56.088014 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-5459f59c-7aee-47da-8b14-dac715193914 tempest-VolumesNegativeTest-773084915 tempest-VolumesNegativeTest-773084915-project] 10.222.0.20 "GET /compute/v2.1/servers/d214d3a1-82b9-446d-b3b7-5dbc90544bee" status: 200 len: 1315 microversion: 2.1 time: 0.172126 Jul 05 21:00:56.088789 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 361/741] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 21:00:55 2022] GET /compute/v2.1/servers/d214d3a1-82b9-446d-b3b7-5dbc90544bee => generated 1315 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 21:00:56.110639 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-5688d6b7-9ca3-4fe8-b99b-c432eabbc2c6 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 21:00:56.111193 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-5688d6b7-9ca3-4fe8-b99b-c432eabbc2c6 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] [instance: f236112c-4649-478b-a626-b84f8ff1bfe9] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 21:00:56.118015 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-5688d6b7-9ca3-4fe8-b99b-c432eabbc2c6 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:00:56.118462 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-5688d6b7-9ca3-4fe8-b99b-c432eabbc2c6 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:00:56.119229 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-5688d6b7-9ca3-4fe8-b99b-c432eabbc2c6 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:00:56.119665 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-5688d6b7-9ca3-4fe8-b99b-c432eabbc2c6 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:00:56.135958 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.wsgi [None req-5688d6b7-9ca3-4fe8-b99b-c432eabbc2c6 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] HTTP exception thrown: Instance f236112c-4649-478b-a626-b84f8ff1bfe9 could not be found. Jul 05 21:00:56.137647 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-5688d6b7-9ca3-4fe8-b99b-c432eabbc2c6 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Request method failure captured: Jul 05 21:00:56.137647 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: request: DELETE /compute/v2.1/servers/f236112c-4649-478b-a626-b84f8ff1bfe9 HTTP/1.1 Jul 05 21:00:56.137647 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: Accept: application/json Jul 05 21:00:56.137647 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: Accept-Encoding: identity Jul 05 21:00:56.137647 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: Connection: close Jul 05 21:00:56.137647 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: Content-Length: 0 Jul 05 21:00:56.137647 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: Content-Type: application/json Jul 05 21:00:56.137647 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: Host: 10.222.0.20 Jul 05 21:00:56.137647 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: Openstack-System-Scope: None Jul 05 21:00:56.137647 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: User-Agent: python-urllib3/1.26.9 Jul 05 21:00:56.137647 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Auth-Token: gAAAAABixKUH4B5j0zEKvinNFBojvLuZ2PCmMo7rFpX95lsIdciwUpaZiEjJqc2l7qkZUkg05gnf1DMkOon_2FSnNiTU4Un89EcTxDLACWDM3hYnFg_2VDZ7GVK518HYK24njE8pU7e7WNMFX96QTUmXce3fdv9VwGLE0AsaMMcaWY3KTSQ4MzU Jul 05 21:00:56.137647 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Domain-Id: None Jul 05 21:00:56.137647 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Domain-Name: None Jul 05 21:00:56.137647 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Identity-Status: Confirmed Jul 05 21:00:56.137647 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Is-Admin-Project: True Jul 05 21:00:56.137647 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Project-Domain-Id: default Jul 05 21:00:56.137647 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Project-Domain-Name: Default Jul 05 21:00:56.137647 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Project-Id: c47e1ad014d542f98f6b24c8a504d166 Jul 05 21:00:56.137647 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Project-Name: tempest-AttachVolumeTestJSON-2080646407 Jul 05 21:00:56.137647 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Role: member,reader Jul 05 21:00:56.137647 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Roles: member,reader Jul 05 21:00:56.140513 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c47e1ad014d542f98f6b24c8a504d166"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/c47e1ad014d542f98f6b24c8a504d166"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_c47e1ad014d542f98f6b24c8a504d166"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c47e1ad014d542f98f6b24c8a504d166"}]}] Jul 05 21:00:56.140513 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Tenant: tempest-AttachVolumeTestJSON-2080646407 Jul 05 21:00:56.140513 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Tenant-Id: c47e1ad014d542f98f6b24c8a504d166 Jul 05 21:00:56.140513 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2080646407 Jul 05 21:00:56.140513 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-User: tempest-AttachVolumeTestJSON-2080646407-project Jul 05 21:00:56.140513 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-User-Domain-Id: default Jul 05 21:00:56.140513 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-User-Domain-Name: Default Jul 05 21:00:56.140513 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-User-Id: 5eac41ce3f04450b840cff305ec1a5ac Jul 05 21:00:56.140513 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-User-Name: tempest-AttachVolumeTestJSON-2080646407-project Jul 05 21:00:56.140513 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: method: > Jul 05 21:00:56.140513 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: exception: Instance f236112c-4649-478b-a626-b84f8ff1bfe9 could not be found. Jul 05 21:00:56.140513 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: action_args: {'id': 'f236112c-4649-478b-a626-b84f8ff1bfe9'} Jul 05 21:00:56.142220 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 05 21:00:56.142220 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 21:00:56.142220 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 05 21:00:56.142220 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 05 21:00:56.142220 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 05 21:00:56.142220 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 05 21:00:56.142220 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 05 21:00:56.142220 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 05 21:00:56.142220 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 05 21:00:56.142220 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 05 21:00:56.142220 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f236112c-4649-478b-a626-b84f8ff1bfe9 could not be found. Jul 05 21:00:56.142220 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi Jul 05 21:00:56.142220 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 21:00:56.142220 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi Jul 05 21:00:56.142220 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 21:00:56.142220 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 21:00:56.142220 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 21:00:56.142220 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 05 21:00:56.142220 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 05 21:00:56.142220 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 05 21:00:56.146345 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 05 21:00:56.146345 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 05 21:00:56.146345 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 05 21:00:56.146345 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 05 21:00:56.146345 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 05 21:00:56.146345 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 05 21:00:56.146345 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 05 21:00:56.146345 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 05 21:00:56.146345 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 05 21:00:56.146345 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f236112c-4649-478b-a626-b84f8ff1bfe9 could not be found. Jul 05 21:00:56.146345 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi Jul 05 21:00:56.146345 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 21:00:56.146345 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi Jul 05 21:00:56.146345 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 21:00:56.146345 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 21:00:56.146345 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 21:00:56.146345 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 05 21:00:56.146345 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 05 21:00:56.146345 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f236112c-4649-478b-a626-b84f8ff1bfe9 could not be found. Jul 05 21:00:56.146345 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi Jul 05 21:00:56.147808 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-5688d6b7-9ca3-4fe8-b99b-c432eabbc2c6 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Returning 404 to user: Instance f236112c-4649-478b-a626-b84f8ff1bfe9 could not be found. {{(pid=117628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 05 21:00:56.147808 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-5688d6b7-9ca3-4fe8-b99b-c432eabbc2c6 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] 10.222.0.20 "DELETE /compute/v2.1/servers/f236112c-4649-478b-a626-b84f8ff1bfe9" status: 404 len: 111 microversion: 2.1 time: 0.032526 Jul 05 21:00:56.147808 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 381/742] 10.222.0.20 () {58 vars in 1238 bytes} [Tue Jul 5 21:00:56 2022] DELETE /compute/v2.1/servers/f236112c-4649-478b-a626-b84f8ff1bfe9 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 05 21:00:56.148953 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-d10cce9e-809d-492b-b81a-59e2f9005237 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 21:00:56.149524 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-d10cce9e-809d-492b-b81a-59e2f9005237 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] [instance: f236112c-4649-478b-a626-b84f8ff1bfe9] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 21:00:56.155646 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-d10cce9e-809d-492b-b81a-59e2f9005237 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:00:56.156848 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-d10cce9e-809d-492b-b81a-59e2f9005237 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:00:56.157651 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-d10cce9e-809d-492b-b81a-59e2f9005237 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:00:56.158084 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-d10cce9e-809d-492b-b81a-59e2f9005237 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:00:56.173889 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.wsgi [None req-d10cce9e-809d-492b-b81a-59e2f9005237 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] HTTP exception thrown: Instance f236112c-4649-478b-a626-b84f8ff1bfe9 could not be found. Jul 05 21:00:56.175711 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-d10cce9e-809d-492b-b81a-59e2f9005237 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Request method failure captured: Jul 05 21:00:56.175711 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: request: GET /compute/v2.1/servers/f236112c-4649-478b-a626-b84f8ff1bfe9 HTTP/1.1 Jul 05 21:00:56.175711 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: Accept: application/json Jul 05 21:00:56.175711 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: Accept-Encoding: identity Jul 05 21:00:56.175711 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: Connection: close Jul 05 21:00:56.175711 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: Content-Length: 0 Jul 05 21:00:56.175711 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: Content-Type: application/json Jul 05 21:00:56.175711 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: Host: 10.222.0.20 Jul 05 21:00:56.175711 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: Openstack-System-Scope: None Jul 05 21:00:56.175711 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: User-Agent: python-urllib3/1.26.9 Jul 05 21:00:56.175711 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Auth-Token: gAAAAABixKUH4B5j0zEKvinNFBojvLuZ2PCmMo7rFpX95lsIdciwUpaZiEjJqc2l7qkZUkg05gnf1DMkOon_2FSnNiTU4Un89EcTxDLACWDM3hYnFg_2VDZ7GVK518HYK24njE8pU7e7WNMFX96QTUmXce3fdv9VwGLE0AsaMMcaWY3KTSQ4MzU Jul 05 21:00:56.175711 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Domain-Id: None Jul 05 21:00:56.175711 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Domain-Name: None Jul 05 21:00:56.175711 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Identity-Status: Confirmed Jul 05 21:00:56.175711 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Is-Admin-Project: True Jul 05 21:00:56.175711 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Project-Domain-Id: default Jul 05 21:00:56.175711 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Project-Domain-Name: Default Jul 05 21:00:56.175711 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Project-Id: c47e1ad014d542f98f6b24c8a504d166 Jul 05 21:00:56.175711 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Project-Name: tempest-AttachVolumeTestJSON-2080646407 Jul 05 21:00:56.175711 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Role: member,reader Jul 05 21:00:56.175711 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Roles: member,reader Jul 05 21:00:56.177806 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c47e1ad014d542f98f6b24c8a504d166"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/c47e1ad014d542f98f6b24c8a504d166"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_c47e1ad014d542f98f6b24c8a504d166"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c47e1ad014d542f98f6b24c8a504d166"}]}] Jul 05 21:00:56.177806 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Tenant: tempest-AttachVolumeTestJSON-2080646407 Jul 05 21:00:56.177806 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Tenant-Id: c47e1ad014d542f98f6b24c8a504d166 Jul 05 21:00:56.177806 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2080646407 Jul 05 21:00:56.177806 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-User: tempest-AttachVolumeTestJSON-2080646407-project Jul 05 21:00:56.177806 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-User-Domain-Id: default Jul 05 21:00:56.177806 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-User-Domain-Name: Default Jul 05 21:00:56.177806 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-User-Id: 5eac41ce3f04450b840cff305ec1a5ac Jul 05 21:00:56.177806 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-User-Name: tempest-AttachVolumeTestJSON-2080646407-project Jul 05 21:00:56.177806 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: method: > Jul 05 21:00:56.177806 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: exception: Instance f236112c-4649-478b-a626-b84f8ff1bfe9 could not be found. Jul 05 21:00:56.177806 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: action_args: {'id': 'f236112c-4649-478b-a626-b84f8ff1bfe9'} Jul 05 21:00:56.179402 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 05 21:00:56.179402 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 21:00:56.179402 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 05 21:00:56.179402 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 05 21:00:56.179402 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 05 21:00:56.179402 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 05 21:00:56.179402 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 05 21:00:56.179402 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 05 21:00:56.179402 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 05 21:00:56.179402 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 05 21:00:56.179402 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f236112c-4649-478b-a626-b84f8ff1bfe9 could not be found. Jul 05 21:00:56.179402 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi Jul 05 21:00:56.179402 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 21:00:56.179402 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi Jul 05 21:00:56.179402 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 21:00:56.179402 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 21:00:56.179402 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 21:00:56.179402 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 05 21:00:56.179402 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 05 21:00:56.179402 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 05 21:00:56.181837 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 05 21:00:56.181837 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 05 21:00:56.181837 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 05 21:00:56.181837 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 05 21:00:56.181837 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 05 21:00:56.181837 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 05 21:00:56.181837 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 05 21:00:56.181837 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f236112c-4649-478b-a626-b84f8ff1bfe9 could not be found. Jul 05 21:00:56.181837 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi Jul 05 21:00:56.181837 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 21:00:56.181837 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi Jul 05 21:00:56.181837 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 21:00:56.181837 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 21:00:56.181837 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 21:00:56.181837 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 05 21:00:56.181837 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 05 21:00:56.181837 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f236112c-4649-478b-a626-b84f8ff1bfe9 could not be found. Jul 05 21:00:56.181837 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi Jul 05 21:00:56.183163 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-d10cce9e-809d-492b-b81a-59e2f9005237 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] Returning 404 to user: Instance f236112c-4649-478b-a626-b84f8ff1bfe9 could not be found. {{(pid=117627) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 05 21:00:56.183163 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-d10cce9e-809d-492b-b81a-59e2f9005237 tempest-AttachVolumeTestJSON-2080646407 tempest-AttachVolumeTestJSON-2080646407-project] 10.222.0.20 "GET /compute/v2.1/servers/f236112c-4649-478b-a626-b84f8ff1bfe9" status: 404 len: 111 microversion: 2.1 time: 0.033389 Jul 05 21:00:56.183163 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 362/743] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 21:00:56 2022] GET /compute/v2.1/servers/f236112c-4649-478b-a626-b84f8ff1bfe9 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 05 21:00:57.104237 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-4dc47b98-afaf-4f0e-9033-461832a002ea tempest-VolumesNegativeTest-773084915 tempest-VolumesNegativeTest-773084915-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 21:00:57.104852 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-4dc47b98-afaf-4f0e-9033-461832a002ea tempest-VolumesNegativeTest-773084915 tempest-VolumesNegativeTest-773084915-project] [instance: d214d3a1-82b9-446d-b3b7-5dbc90544bee] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 21:00:57.111069 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-4dc47b98-afaf-4f0e-9033-461832a002ea tempest-VolumesNegativeTest-773084915 tempest-VolumesNegativeTest-773084915-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:00:57.111679 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-4dc47b98-afaf-4f0e-9033-461832a002ea tempest-VolumesNegativeTest-773084915 tempest-VolumesNegativeTest-773084915-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:00:57.112274 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-4dc47b98-afaf-4f0e-9033-461832a002ea tempest-VolumesNegativeTest-773084915 tempest-VolumesNegativeTest-773084915-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:00:57.113750 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-4dc47b98-afaf-4f0e-9033-461832a002ea tempest-VolumesNegativeTest-773084915 tempest-VolumesNegativeTest-773084915-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:00:57.251767 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-4dc47b98-afaf-4f0e-9033-461832a002ea tempest-VolumesNegativeTest-773084915 tempest-VolumesNegativeTest-773084915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b26cb0743ba46809d9a9f414ae7555c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '983b3f0a085c45508d9a90a1b636a142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 21:00:57.260377 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-4dc47b98-afaf-4f0e-9033-461832a002ea tempest-VolumesNegativeTest-773084915 tempest-VolumesNegativeTest-773084915-project] 10.222.0.20 "GET /compute/v2.1/servers/d214d3a1-82b9-446d-b3b7-5dbc90544bee" status: 200 len: 1315 microversion: 2.1 time: 0.159999 Jul 05 21:00:57.264667 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 382/744] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 21:00:57 2022] GET /compute/v2.1/servers/d214d3a1-82b9-446d-b3b7-5dbc90544bee => generated 1315 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 21:00:58.282098 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-48cd840b-5a1f-49d4-a34d-a966848e4ded tempest-VolumesNegativeTest-773084915 tempest-VolumesNegativeTest-773084915-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 21:00:58.282696 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-48cd840b-5a1f-49d4-a34d-a966848e4ded tempest-VolumesNegativeTest-773084915 tempest-VolumesNegativeTest-773084915-project] [instance: d214d3a1-82b9-446d-b3b7-5dbc90544bee] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 21:00:58.290496 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-48cd840b-5a1f-49d4-a34d-a966848e4ded tempest-VolumesNegativeTest-773084915 tempest-VolumesNegativeTest-773084915-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:00:58.290940 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-48cd840b-5a1f-49d4-a34d-a966848e4ded tempest-VolumesNegativeTest-773084915 tempest-VolumesNegativeTest-773084915-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:00:58.291697 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-48cd840b-5a1f-49d4-a34d-a966848e4ded tempest-VolumesNegativeTest-773084915 tempest-VolumesNegativeTest-773084915-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:00:58.292154 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-48cd840b-5a1f-49d4-a34d-a966848e4ded tempest-VolumesNegativeTest-773084915 tempest-VolumesNegativeTest-773084915-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:00:58.461526 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-48cd840b-5a1f-49d4-a34d-a966848e4ded tempest-VolumesNegativeTest-773084915 tempest-VolumesNegativeTest-773084915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b26cb0743ba46809d9a9f414ae7555c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '983b3f0a085c45508d9a90a1b636a142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 21:00:58.471269 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-48cd840b-5a1f-49d4-a34d-a966848e4ded tempest-VolumesNegativeTest-773084915 tempest-VolumesNegativeTest-773084915-project] 10.222.0.20 "GET /compute/v2.1/servers/d214d3a1-82b9-446d-b3b7-5dbc90544bee" status: 200 len: 1315 microversion: 2.1 time: 0.193092 Jul 05 21:00:58.481325 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 363/745] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 21:00:58 2022] GET /compute/v2.1/servers/d214d3a1-82b9-446d-b3b7-5dbc90544bee => generated 1315 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 21:00:59.489528 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-ad0d5aa1-8653-4545-a34b-e14fefb9b8b8 tempest-VolumesNegativeTest-773084915 tempest-VolumesNegativeTest-773084915-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 21:00:59.490141 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-ad0d5aa1-8653-4545-a34b-e14fefb9b8b8 tempest-VolumesNegativeTest-773084915 tempest-VolumesNegativeTest-773084915-project] [instance: d214d3a1-82b9-446d-b3b7-5dbc90544bee] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 21:00:59.492578 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG dbcounter [-] [117628] Writing DB stats nova_api:SELECT=63,nova_api:UPDATE=1,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=117628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:00:59.498801 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-ad0d5aa1-8653-4545-a34b-e14fefb9b8b8 tempest-VolumesNegativeTest-773084915 tempest-VolumesNegativeTest-773084915-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:00:59.499366 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-ad0d5aa1-8653-4545-a34b-e14fefb9b8b8 tempest-VolumesNegativeTest-773084915 tempest-VolumesNegativeTest-773084915-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:00:59.500225 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-ad0d5aa1-8653-4545-a34b-e14fefb9b8b8 tempest-VolumesNegativeTest-773084915 tempest-VolumesNegativeTest-773084915-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:00:59.500782 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-ad0d5aa1-8653-4545-a34b-e14fefb9b8b8 tempest-VolumesNegativeTest-773084915 tempest-VolumesNegativeTest-773084915-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:00:59.755292 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-ad0d5aa1-8653-4545-a34b-e14fefb9b8b8 tempest-VolumesNegativeTest-773084915 tempest-VolumesNegativeTest-773084915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b26cb0743ba46809d9a9f414ae7555c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '983b3f0a085c45508d9a90a1b636a142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 21:00:59.772315 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-ad0d5aa1-8653-4545-a34b-e14fefb9b8b8 tempest-VolumesNegativeTest-773084915 tempest-VolumesNegativeTest-773084915-project] 10.222.0.20 "GET /compute/v2.1/servers/d214d3a1-82b9-446d-b3b7-5dbc90544bee" status: 200 len: 1315 microversion: 2.1 time: 0.287076 Jul 05 21:00:59.777403 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 383/746] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 21:00:59 2022] GET /compute/v2.1/servers/d214d3a1-82b9-446d-b3b7-5dbc90544bee => generated 1315 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 21:00:59.901831 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [req-ad2c22a3-44c4-4ed7-b0e3-aa76a781e524 req-d8c5541e-4219-4e11-8ad5-3cfdabaf6c9f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d214d3a1-82b9-446d-b3b7-5dbc90544bee", "name": "network-vif-plugged", "status": "completed", "tag": "8d2908ef-7443-45fc-983f-d7e1c1eb447f"}]} {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 21:00:59.906192 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG dbcounter [-] [117627] Writing DB stats nova_api:SELECT=50 {{(pid=117627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:00:59.913637 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [req-ad2c22a3-44c4-4ed7-b0e3-aa76a781e524 req-d8c5541e-4219-4e11-8ad5-3cfdabaf6c9f service nova] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:00:59.914276 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [req-ad2c22a3-44c4-4ed7-b0e3-aa76a781e524 req-d8c5541e-4219-4e11-8ad5-3cfdabaf6c9f service nova] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:00:59.927769 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.compute.server_external_events [req-ad2c22a3-44c4-4ed7-b0e3-aa76a781e524 req-d8c5541e-4219-4e11-8ad5-3cfdabaf6c9f service nova] Creating event network-vif-plugged:8d2908ef-7443-45fc-983f-d7e1c1eb447f for instance d214d3a1-82b9-446d-b3b7-5dbc90544bee on hv-cinder-79760 Jul 05 21:00:59.933062 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [req-ad2c22a3-44c4-4ed7-b0e3-aa76a781e524 req-d8c5541e-4219-4e11-8ad5-3cfdabaf6c9f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035084 Jul 05 21:00:59.933661 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 364/747] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 5 21:00:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 21:01:00.799830 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-405de20d-c978-4adb-b9c5-198cde68d63f tempest-VolumesNegativeTest-773084915 tempest-VolumesNegativeTest-773084915-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 21:01:00.800528 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-405de20d-c978-4adb-b9c5-198cde68d63f tempest-VolumesNegativeTest-773084915 tempest-VolumesNegativeTest-773084915-project] [instance: d214d3a1-82b9-446d-b3b7-5dbc90544bee] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 21:01:00.802440 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG dbcounter [-] [117628] Writing DB stats nova_cell0:SELECT=2 {{(pid=117628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:01:00.803088 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG dbcounter [-] [117628] Writing DB stats nova_cell0:SELECT=6 {{(pid=117628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:01:00.809640 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-405de20d-c978-4adb-b9c5-198cde68d63f tempest-VolumesNegativeTest-773084915 tempest-VolumesNegativeTest-773084915-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:01:00.810096 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-405de20d-c978-4adb-b9c5-198cde68d63f tempest-VolumesNegativeTest-773084915 tempest-VolumesNegativeTest-773084915-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:01:00.810857 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-405de20d-c978-4adb-b9c5-198cde68d63f tempest-VolumesNegativeTest-773084915 tempest-VolumesNegativeTest-773084915-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:01:00.811296 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-405de20d-c978-4adb-b9c5-198cde68d63f tempest-VolumesNegativeTest-773084915 tempest-VolumesNegativeTest-773084915-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:01:00.942505 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-405de20d-c978-4adb-b9c5-198cde68d63f tempest-VolumesNegativeTest-773084915 tempest-VolumesNegativeTest-773084915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b26cb0743ba46809d9a9f414ae7555c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '983b3f0a085c45508d9a90a1b636a142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 21:01:00.949895 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-405de20d-c978-4adb-b9c5-198cde68d63f tempest-VolumesNegativeTest-773084915 tempest-VolumesNegativeTest-773084915-project] 10.222.0.20 "GET /compute/v2.1/servers/d214d3a1-82b9-446d-b3b7-5dbc90544bee" status: 200 len: 1315 microversion: 2.1 time: 0.153888 Jul 05 21:01:00.950637 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 384/748] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 21:01:00 2022] GET /compute/v2.1/servers/d214d3a1-82b9-446d-b3b7-5dbc90544bee => generated 1315 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 21:01:01.963565 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG dbcounter [-] [117627] Writing DB stats nova_cell0:SELECT=2 {{(pid=117627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:01:01.968467 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-2759a525-a5bb-435d-b136-d7c86bbd55a1 tempest-VolumesNegativeTest-773084915 tempest-VolumesNegativeTest-773084915-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 21:01:01.969275 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-2759a525-a5bb-435d-b136-d7c86bbd55a1 tempest-VolumesNegativeTest-773084915 tempest-VolumesNegativeTest-773084915-project] [instance: d214d3a1-82b9-446d-b3b7-5dbc90544bee] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 21:01:01.977118 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-2759a525-a5bb-435d-b136-d7c86bbd55a1 tempest-VolumesNegativeTest-773084915 tempest-VolumesNegativeTest-773084915-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:01:01.977567 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-2759a525-a5bb-435d-b136-d7c86bbd55a1 tempest-VolumesNegativeTest-773084915 tempest-VolumesNegativeTest-773084915-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:01:01.978332 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-2759a525-a5bb-435d-b136-d7c86bbd55a1 tempest-VolumesNegativeTest-773084915 tempest-VolumesNegativeTest-773084915-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:01:01.978768 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-2759a525-a5bb-435d-b136-d7c86bbd55a1 tempest-VolumesNegativeTest-773084915 tempest-VolumesNegativeTest-773084915-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:01:02.162281 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-2759a525-a5bb-435d-b136-d7c86bbd55a1 tempest-VolumesNegativeTest-773084915 tempest-VolumesNegativeTest-773084915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b26cb0743ba46809d9a9f414ae7555c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '983b3f0a085c45508d9a90a1b636a142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 21:01:02.169753 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-2759a525-a5bb-435d-b136-d7c86bbd55a1 tempest-VolumesNegativeTest-773084915 tempest-VolumesNegativeTest-773084915-project] 10.222.0.20 "GET /compute/v2.1/servers/d214d3a1-82b9-446d-b3b7-5dbc90544bee" status: 200 len: 1464 microversion: 2.1 time: 0.207077 Jul 05 21:01:02.170324 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 365/749] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 21:01:01 2022] GET /compute/v2.1/servers/d214d3a1-82b9-446d-b3b7-5dbc90544bee => generated 1464 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 21:01:02.225092 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-e68a4abd-017b-4369-8bc2-ed4db1d2e505 tempest-VolumesNegativeTest-773084915 tempest-VolumesNegativeTest-773084915-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 21:01:02.225627 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-e68a4abd-017b-4369-8bc2-ed4db1d2e505 tempest-VolumesNegativeTest-773084915 tempest-VolumesNegativeTest-773084915-project] [instance: d214d3a1-82b9-446d-b3b7-5dbc90544bee] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 21:01:02.232039 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-e68a4abd-017b-4369-8bc2-ed4db1d2e505 tempest-VolumesNegativeTest-773084915 tempest-VolumesNegativeTest-773084915-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:01:02.232484 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-e68a4abd-017b-4369-8bc2-ed4db1d2e505 tempest-VolumesNegativeTest-773084915 tempest-VolumesNegativeTest-773084915-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:01:02.233277 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-e68a4abd-017b-4369-8bc2-ed4db1d2e505 tempest-VolumesNegativeTest-773084915 tempest-VolumesNegativeTest-773084915-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:01:02.233716 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-e68a4abd-017b-4369-8bc2-ed4db1d2e505 tempest-VolumesNegativeTest-773084915 tempest-VolumesNegativeTest-773084915-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:01:02.260301 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-e68a4abd-017b-4369-8bc2-ed4db1d2e505 tempest-VolumesNegativeTest-773084915 tempest-VolumesNegativeTest-773084915-project] [instance: d214d3a1-82b9-446d-b3b7-5dbc90544bee] Going to try to terminate instance {{(pid=117628) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 05 21:01:02.347847 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-e68a4abd-017b-4369-8bc2-ed4db1d2e505 tempest-VolumesNegativeTest-773084915 tempest-VolumesNegativeTest-773084915-project] 10.222.0.20 "DELETE /compute/v2.1/servers/d214d3a1-82b9-446d-b3b7-5dbc90544bee" status: 204 len: 0 microversion: 2.1 time: 0.126577 Jul 05 21:01:02.349098 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 385/750] 10.222.0.20 () {58 vars in 1238 bytes} [Tue Jul 5 21:01:02 2022] DELETE /compute/v2.1/servers/d214d3a1-82b9-446d-b3b7-5dbc90544bee => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 05 21:01:02.358038 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-ca25a9c2-9c09-4f3e-816a-4915ab9364bd tempest-VolumesNegativeTest-773084915 tempest-VolumesNegativeTest-773084915-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 21:01:02.358652 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-ca25a9c2-9c09-4f3e-816a-4915ab9364bd tempest-VolumesNegativeTest-773084915 tempest-VolumesNegativeTest-773084915-project] [instance: d214d3a1-82b9-446d-b3b7-5dbc90544bee] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 21:01:02.372637 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-ca25a9c2-9c09-4f3e-816a-4915ab9364bd tempest-VolumesNegativeTest-773084915 tempest-VolumesNegativeTest-773084915-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:01:02.373124 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-ca25a9c2-9c09-4f3e-816a-4915ab9364bd tempest-VolumesNegativeTest-773084915 tempest-VolumesNegativeTest-773084915-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:01:02.374714 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-ca25a9c2-9c09-4f3e-816a-4915ab9364bd tempest-VolumesNegativeTest-773084915 tempest-VolumesNegativeTest-773084915-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:01:02.375169 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-ca25a9c2-9c09-4f3e-816a-4915ab9364bd tempest-VolumesNegativeTest-773084915 tempest-VolumesNegativeTest-773084915-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:01:02.515125 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-ca25a9c2-9c09-4f3e-816a-4915ab9364bd tempest-VolumesNegativeTest-773084915 tempest-VolumesNegativeTest-773084915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b26cb0743ba46809d9a9f414ae7555c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '983b3f0a085c45508d9a90a1b636a142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 21:01:02.524196 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-ca25a9c2-9c09-4f3e-816a-4915ab9364bd tempest-VolumesNegativeTest-773084915 tempest-VolumesNegativeTest-773084915-project] 10.222.0.20 "GET /compute/v2.1/servers/d214d3a1-82b9-446d-b3b7-5dbc90544bee" status: 200 len: 1470 microversion: 2.1 time: 0.170942 Jul 05 21:01:02.524756 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 366/751] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 21:01:02 2022] GET /compute/v2.1/servers/d214d3a1-82b9-446d-b3b7-5dbc90544bee => generated 1470 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 21:01:03.541617 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-16edf57c-f27b-4c7e-978c-43ffb367b3d1 tempest-VolumesNegativeTest-773084915 tempest-VolumesNegativeTest-773084915-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 21:01:03.542312 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-16edf57c-f27b-4c7e-978c-43ffb367b3d1 tempest-VolumesNegativeTest-773084915 tempest-VolumesNegativeTest-773084915-project] [instance: d214d3a1-82b9-446d-b3b7-5dbc90544bee] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 21:01:03.550085 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-16edf57c-f27b-4c7e-978c-43ffb367b3d1 tempest-VolumesNegativeTest-773084915 tempest-VolumesNegativeTest-773084915-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:01:03.550747 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-16edf57c-f27b-4c7e-978c-43ffb367b3d1 tempest-VolumesNegativeTest-773084915 tempest-VolumesNegativeTest-773084915-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:01:03.551665 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-16edf57c-f27b-4c7e-978c-43ffb367b3d1 tempest-VolumesNegativeTest-773084915 tempest-VolumesNegativeTest-773084915-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:01:03.552101 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-16edf57c-f27b-4c7e-978c-43ffb367b3d1 tempest-VolumesNegativeTest-773084915 tempest-VolumesNegativeTest-773084915-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:01:03.689716 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-16edf57c-f27b-4c7e-978c-43ffb367b3d1 tempest-VolumesNegativeTest-773084915 tempest-VolumesNegativeTest-773084915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b26cb0743ba46809d9a9f414ae7555c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '983b3f0a085c45508d9a90a1b636a142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 21:01:03.693889 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG dbcounter [-] [117628] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:01:03.699835 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-16edf57c-f27b-4c7e-978c-43ffb367b3d1 tempest-VolumesNegativeTest-773084915 tempest-VolumesNegativeTest-773084915-project] 10.222.0.20 "GET /compute/v2.1/servers/d214d3a1-82b9-446d-b3b7-5dbc90544bee" status: 200 len: 1470 microversion: 2.1 time: 0.162436 Jul 05 21:01:03.700604 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 386/752] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 21:01:03 2022] GET /compute/v2.1/servers/d214d3a1-82b9-446d-b3b7-5dbc90544bee => generated 1470 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 21:01:04.479983 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [req-2bea6ac2-0749-41cf-a4bb-a37309cb7361 req-6b2497ae-d99d-48ea-b6a5-3187cbf83f17 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d214d3a1-82b9-446d-b3b7-5dbc90544bee", "name": "network-vif-deleted", "tag": "8d2908ef-7443-45fc-983f-d7e1c1eb447f"}]} {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 21:01:04.503905 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [req-2bea6ac2-0749-41cf-a4bb-a37309cb7361 req-6b2497ae-d99d-48ea-b6a5-3187cbf83f17 service nova] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:01:04.504452 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [req-2bea6ac2-0749-41cf-a4bb-a37309cb7361 req-6b2497ae-d99d-48ea-b6a5-3187cbf83f17 service nova] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:01:04.521541 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.compute.server_external_events [req-2bea6ac2-0749-41cf-a4bb-a37309cb7361 req-6b2497ae-d99d-48ea-b6a5-3187cbf83f17 service nova] Creating event network-vif-deleted:8d2908ef-7443-45fc-983f-d7e1c1eb447f for instance d214d3a1-82b9-446d-b3b7-5dbc90544bee on hv-cinder-79760 Jul 05 21:01:04.529530 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [req-2bea6ac2-0749-41cf-a4bb-a37309cb7361 req-6b2497ae-d99d-48ea-b6a5-3187cbf83f17 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064745 Jul 05 21:01:04.530895 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 367/753] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 5 21:01:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 21:01:04.719100 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-9f54d960-ebeb-4ac5-9157-42fffe3fe14d tempest-VolumesNegativeTest-773084915 tempest-VolumesNegativeTest-773084915-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 21:01:04.719710 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-9f54d960-ebeb-4ac5-9157-42fffe3fe14d tempest-VolumesNegativeTest-773084915 tempest-VolumesNegativeTest-773084915-project] [instance: d214d3a1-82b9-446d-b3b7-5dbc90544bee] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 21:01:04.727852 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-9f54d960-ebeb-4ac5-9157-42fffe3fe14d tempest-VolumesNegativeTest-773084915 tempest-VolumesNegativeTest-773084915-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:01:04.728300 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-9f54d960-ebeb-4ac5-9157-42fffe3fe14d tempest-VolumesNegativeTest-773084915 tempest-VolumesNegativeTest-773084915-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:01:04.729095 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-9f54d960-ebeb-4ac5-9157-42fffe3fe14d tempest-VolumesNegativeTest-773084915 tempest-VolumesNegativeTest-773084915-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:01:04.729534 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-9f54d960-ebeb-4ac5-9157-42fffe3fe14d tempest-VolumesNegativeTest-773084915 tempest-VolumesNegativeTest-773084915-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:01:04.763564 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-9f54d960-ebeb-4ac5-9157-42fffe3fe14d tempest-VolumesNegativeTest-773084915 tempest-VolumesNegativeTest-773084915-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:01:04.764321 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-9f54d960-ebeb-4ac5-9157-42fffe3fe14d tempest-VolumesNegativeTest-773084915 tempest-VolumesNegativeTest-773084915-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:01:04.764974 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.objects.instance [None req-9f54d960-ebeb-4ac5-9157-42fffe3fe14d tempest-VolumesNegativeTest-773084915 tempest-VolumesNegativeTest-773084915-project] Lazy-loading 'fault' on Instance uuid d214d3a1-82b9-446d-b3b7-5dbc90544bee {{(pid=117628) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 05 21:01:04.813794 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-9f54d960-ebeb-4ac5-9157-42fffe3fe14d tempest-VolumesNegativeTest-773084915 tempest-VolumesNegativeTest-773084915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b26cb0743ba46809d9a9f414ae7555c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '983b3f0a085c45508d9a90a1b636a142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 21:01:04.821789 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-9f54d960-ebeb-4ac5-9157-42fffe3fe14d tempest-VolumesNegativeTest-773084915 tempest-VolumesNegativeTest-773084915-project] 10.222.0.20 "GET /compute/v2.1/servers/d214d3a1-82b9-446d-b3b7-5dbc90544bee" status: 200 len: 1305 microversion: 2.1 time: 0.107506 Jul 05 21:01:04.822736 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 387/754] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 21:01:04 2022] GET /compute/v2.1/servers/d214d3a1-82b9-446d-b3b7-5dbc90544bee => generated 1305 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 21:01:05.839850 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-421a5bb0-c7cd-4eab-ab5e-6b25fb30ec85 tempest-VolumesNegativeTest-773084915 tempest-VolumesNegativeTest-773084915-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 21:01:05.840668 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-421a5bb0-c7cd-4eab-ab5e-6b25fb30ec85 tempest-VolumesNegativeTest-773084915 tempest-VolumesNegativeTest-773084915-project] [instance: d214d3a1-82b9-446d-b3b7-5dbc90544bee] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 21:01:05.848219 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-421a5bb0-c7cd-4eab-ab5e-6b25fb30ec85 tempest-VolumesNegativeTest-773084915 tempest-VolumesNegativeTest-773084915-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:01:05.848647 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-421a5bb0-c7cd-4eab-ab5e-6b25fb30ec85 tempest-VolumesNegativeTest-773084915 tempest-VolumesNegativeTest-773084915-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:01:05.849438 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-421a5bb0-c7cd-4eab-ab5e-6b25fb30ec85 tempest-VolumesNegativeTest-773084915 tempest-VolumesNegativeTest-773084915-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:01:05.849875 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-421a5bb0-c7cd-4eab-ab5e-6b25fb30ec85 tempest-VolumesNegativeTest-773084915 tempest-VolumesNegativeTest-773084915-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:01:05.863995 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.wsgi [None req-421a5bb0-c7cd-4eab-ab5e-6b25fb30ec85 tempest-VolumesNegativeTest-773084915 tempest-VolumesNegativeTest-773084915-project] HTTP exception thrown: Instance d214d3a1-82b9-446d-b3b7-5dbc90544bee could not be found. Jul 05 21:01:05.865720 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-421a5bb0-c7cd-4eab-ab5e-6b25fb30ec85 tempest-VolumesNegativeTest-773084915 tempest-VolumesNegativeTest-773084915-project] Request method failure captured: Jul 05 21:01:05.865720 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: request: GET /compute/v2.1/servers/d214d3a1-82b9-446d-b3b7-5dbc90544bee HTTP/1.1 Jul 05 21:01:05.865720 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: Accept: application/json Jul 05 21:01:05.865720 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: Accept-Encoding: identity Jul 05 21:01:05.865720 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: Connection: close Jul 05 21:01:05.865720 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: Content-Length: 0 Jul 05 21:01:05.865720 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: Content-Type: application/json Jul 05 21:01:05.865720 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: Host: 10.222.0.20 Jul 05 21:01:05.865720 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: Openstack-System-Scope: None Jul 05 21:01:05.865720 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: User-Agent: python-urllib3/1.26.9 Jul 05 21:01:05.865720 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Auth-Token: gAAAAABixKaA7QR5n_ocv6dC_bXQVAXwnx1_ZzenbJRoEmTBw5wsNEXApEyBTQwxvUgW9oiokCGr0EvGiM3XqLYyXyGOsqFu3DI49WnOxvoTRZpkGpP3pnRMADPsEfzk6HsajBfTfPlWcEZfno-K2YzOts8sfbE3HO5ey1qWINO7A1r00gmroD4 Jul 05 21:01:05.865720 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Domain-Id: None Jul 05 21:01:05.865720 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Domain-Name: None Jul 05 21:01:05.865720 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Identity-Status: Confirmed Jul 05 21:01:05.865720 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Is-Admin-Project: True Jul 05 21:01:05.865720 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Project-Domain-Id: default Jul 05 21:01:05.865720 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Project-Domain-Name: Default Jul 05 21:01:05.865720 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Project-Id: 983b3f0a085c45508d9a90a1b636a142 Jul 05 21:01:05.865720 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Project-Name: tempest-VolumesNegativeTest-773084915 Jul 05 21:01:05.865720 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Role: member,reader Jul 05 21:01:05.865720 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Roles: member,reader Jul 05 21:01:05.867376 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/983b3f0a085c45508d9a90a1b636a142"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/983b3f0a085c45508d9a90a1b636a142"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_983b3f0a085c45508d9a90a1b636a142"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/983b3f0a085c45508d9a90a1b636a142"}]}] Jul 05 21:01:05.867376 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Tenant: tempest-VolumesNegativeTest-773084915 Jul 05 21:01:05.867376 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Tenant-Id: 983b3f0a085c45508d9a90a1b636a142 Jul 05 21:01:05.867376 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Tenant-Name: tempest-VolumesNegativeTest-773084915 Jul 05 21:01:05.867376 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-User: tempest-VolumesNegativeTest-773084915-project Jul 05 21:01:05.867376 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-User-Domain-Id: default Jul 05 21:01:05.867376 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-User-Domain-Name: Default Jul 05 21:01:05.867376 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-User-Id: 8b26cb0743ba46809d9a9f414ae7555c Jul 05 21:01:05.867376 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-User-Name: tempest-VolumesNegativeTest-773084915-project Jul 05 21:01:05.867376 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: method: > Jul 05 21:01:05.867376 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: exception: Instance d214d3a1-82b9-446d-b3b7-5dbc90544bee could not be found. Jul 05 21:01:05.867376 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: action_args: {'id': 'd214d3a1-82b9-446d-b3b7-5dbc90544bee'} Jul 05 21:01:05.868227 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 05 21:01:05.868227 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 21:01:05.868227 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 05 21:01:05.868227 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 05 21:01:05.868227 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 05 21:01:05.868227 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 05 21:01:05.868227 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 05 21:01:05.868227 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 05 21:01:05.868227 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 05 21:01:05.868227 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 05 21:01:05.868227 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d214d3a1-82b9-446d-b3b7-5dbc90544bee could not be found. Jul 05 21:01:05.868227 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi Jul 05 21:01:05.868227 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 21:01:05.868227 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi Jul 05 21:01:05.868227 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 21:01:05.868227 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 21:01:05.868227 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 21:01:05.868227 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 05 21:01:05.868227 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 05 21:01:05.868227 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 05 21:01:05.869569 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 05 21:01:05.869569 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 05 21:01:05.869569 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 05 21:01:05.869569 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 05 21:01:05.869569 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 05 21:01:05.869569 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 05 21:01:05.869569 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 05 21:01:05.869569 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d214d3a1-82b9-446d-b3b7-5dbc90544bee could not be found. Jul 05 21:01:05.869569 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi Jul 05 21:01:05.869569 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 21:01:05.869569 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi Jul 05 21:01:05.869569 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 21:01:05.869569 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 21:01:05.869569 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 21:01:05.869569 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 05 21:01:05.869569 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 05 21:01:05.869569 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d214d3a1-82b9-446d-b3b7-5dbc90544bee could not be found. Jul 05 21:01:05.869569 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi Jul 05 21:01:05.870850 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-421a5bb0-c7cd-4eab-ab5e-6b25fb30ec85 tempest-VolumesNegativeTest-773084915 tempest-VolumesNegativeTest-773084915-project] Returning 404 to user: Instance d214d3a1-82b9-446d-b3b7-5dbc90544bee could not be found. {{(pid=117627) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 05 21:01:05.870850 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-421a5bb0-c7cd-4eab-ab5e-6b25fb30ec85 tempest-VolumesNegativeTest-773084915 tempest-VolumesNegativeTest-773084915-project] 10.222.0.20 "GET /compute/v2.1/servers/d214d3a1-82b9-446d-b3b7-5dbc90544bee" status: 404 len: 111 microversion: 2.1 time: 0.031500 Jul 05 21:01:05.870850 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 368/755] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 21:01:05 2022] GET /compute/v2.1/servers/d214d3a1-82b9-446d-b3b7-5dbc90544bee => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 05 21:01:11.460650 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-0765838f-e0e1-4144-be4e-445cf9f93848 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 21:01:11.461626 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-0765838f-e0e1-4144-be4e-445cf9f93848 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] [instance: 1b6eabe8-54b0-43cf-94ff-9d4abc8168db] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 21:01:11.468147 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-0765838f-e0e1-4144-be4e-445cf9f93848 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:01:11.468591 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-0765838f-e0e1-4144-be4e-445cf9f93848 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:01:11.469372 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-0765838f-e0e1-4144-be4e-445cf9f93848 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:01:11.469815 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-0765838f-e0e1-4144-be4e-445cf9f93848 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:01:11.504994 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-0765838f-e0e1-4144-be4e-445cf9f93848 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] 10.222.0.20 "GET /compute/v2.1/servers/1b6eabe8-54b0-43cf-94ff-9d4abc8168db/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.049114 Jul 05 21:01:11.506026 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 388/756] 10.222.0.20 () {60 vars in 1342 bytes} [Tue Jul 5 21:01:11 2022] GET /compute/v2.1/servers/1b6eabe8-54b0-43cf-94ff-9d4abc8168db/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 21:01:11.592258 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-a5788e8d-981f-46d1-abc8-41591049252e tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 21:01:11.592771 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-a5788e8d-981f-46d1-abc8-41591049252e tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] [instance: 1b6eabe8-54b0-43cf-94ff-9d4abc8168db] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 21:01:11.600746 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-a5788e8d-981f-46d1-abc8-41591049252e tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:01:11.601519 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-a5788e8d-981f-46d1-abc8-41591049252e tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:01:11.602207 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-a5788e8d-981f-46d1-abc8-41591049252e tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:01:11.602912 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-a5788e8d-981f-46d1-abc8-41591049252e tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:01:11.633899 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-a5788e8d-981f-46d1-abc8-41591049252e tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] [instance: 1b6eabe8-54b0-43cf-94ff-9d4abc8168db] Going to try to terminate instance {{(pid=117627) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 05 21:01:11.650838 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG dbcounter [-] [117627] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=2 {{(pid=117627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:01:11.735650 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-a5788e8d-981f-46d1-abc8-41591049252e tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] 10.222.0.20 "DELETE /compute/v2.1/servers/1b6eabe8-54b0-43cf-94ff-9d4abc8168db" status: 204 len: 0 microversion: 2.20 time: 0.147105 Jul 05 21:01:11.736352 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 369/757] 10.222.0.20 () {60 vars in 1279 bytes} [Tue Jul 5 21:01:11 2022] DELETE /compute/v2.1/servers/1b6eabe8-54b0-43cf-94ff-9d4abc8168db => generated 0 bytes in 150 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 05 21:01:11.745610 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-3febb7bd-1f0b-4f5f-8c99-ee32b3318ec9 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 21:01:11.746311 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-3febb7bd-1f0b-4f5f-8c99-ee32b3318ec9 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] [instance: 1b6eabe8-54b0-43cf-94ff-9d4abc8168db] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 21:01:11.754133 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-3febb7bd-1f0b-4f5f-8c99-ee32b3318ec9 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:01:11.754721 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-3febb7bd-1f0b-4f5f-8c99-ee32b3318ec9 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:01:11.755977 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-3febb7bd-1f0b-4f5f-8c99-ee32b3318ec9 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:01:11.756719 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-3febb7bd-1f0b-4f5f-8c99-ee32b3318ec9 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:01:11.904561 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-3febb7bd-1f0b-4f5f-8c99-ee32b3318ec9 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 21:01:11.913245 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-3febb7bd-1f0b-4f5f-8c99-ee32b3318ec9 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 21:01:11.914741 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-3febb7bd-1f0b-4f5f-8c99-ee32b3318ec9 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 21:01:11.915887 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-3febb7bd-1f0b-4f5f-8c99-ee32b3318ec9 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] 10.222.0.20 "GET /compute/v2.1/servers/1b6eabe8-54b0-43cf-94ff-9d4abc8168db" status: 200 len: 1719 microversion: 2.20 time: 0.174993 Jul 05 21:01:11.916432 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 389/758] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 5 21:01:11 2022] GET /compute/v2.1/servers/1b6eabe8-54b0-43cf-94ff-9d4abc8168db => generated 1719 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 05 21:01:12.947398 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-869853dc-537b-4c19-8c29-9a70cda319e4 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 21:01:12.949625 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-869853dc-537b-4c19-8c29-9a70cda319e4 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] [instance: 1b6eabe8-54b0-43cf-94ff-9d4abc8168db] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 21:01:12.962852 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-869853dc-537b-4c19-8c29-9a70cda319e4 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:01:12.963470 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-869853dc-537b-4c19-8c29-9a70cda319e4 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:01:12.964428 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-869853dc-537b-4c19-8c29-9a70cda319e4 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:01:12.965203 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-869853dc-537b-4c19-8c29-9a70cda319e4 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:01:13.147232 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-869853dc-537b-4c19-8c29-9a70cda319e4 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 21:01:13.155732 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-869853dc-537b-4c19-8c29-9a70cda319e4 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 21:01:13.157499 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-869853dc-537b-4c19-8c29-9a70cda319e4 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 21:01:13.159065 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-869853dc-537b-4c19-8c29-9a70cda319e4 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] 10.222.0.20 "GET /compute/v2.1/servers/1b6eabe8-54b0-43cf-94ff-9d4abc8168db" status: 200 len: 1719 microversion: 2.20 time: 0.227942 Jul 05 21:01:13.159729 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 370/759] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 5 21:01:12 2022] GET /compute/v2.1/servers/1b6eabe8-54b0-43cf-94ff-9d4abc8168db => generated 1719 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 21:01:13.539551 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [req-03f0d497-e138-45dd-8ce0-fb905f5c84af req-5ca9afcd-90e1-4160-a9db-b7bf6ad5a742 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7b18289e-137f-467c-96ec-cc6179f93e17", "tag": "6b603e35-d2c5-47fc-83a0-12c2780e086f"}]} {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 21:01:13.543819 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-8f8c30c6-e9a5-45c4-bb2f-3e024c7dd5cf tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 21:01:13.544332 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-8f8c30c6-e9a5-45c4-bb2f-3e024c7dd5cf tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] [instance: 7b18289e-137f-467c-96ec-cc6179f93e17] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 21:01:13.553328 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-8f8c30c6-e9a5-45c4-bb2f-3e024c7dd5cf tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:01:13.553954 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-8f8c30c6-e9a5-45c4-bb2f-3e024c7dd5cf tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:01:13.554727 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-8f8c30c6-e9a5-45c4-bb2f-3e024c7dd5cf tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:01:13.555161 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-8f8c30c6-e9a5-45c4-bb2f-3e024c7dd5cf tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:01:13.557490 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [req-03f0d497-e138-45dd-8ce0-fb905f5c84af req-5ca9afcd-90e1-4160-a9db-b7bf6ad5a742 service nova] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:01:13.558165 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [req-03f0d497-e138-45dd-8ce0-fb905f5c84af req-5ca9afcd-90e1-4160-a9db-b7bf6ad5a742 service nova] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:01:13.570224 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.compute.server_external_events [req-03f0d497-e138-45dd-8ce0-fb905f5c84af req-5ca9afcd-90e1-4160-a9db-b7bf6ad5a742 service nova] Creating event network-changed:6b603e35-d2c5-47fc-83a0-12c2780e086f for instance 7b18289e-137f-467c-96ec-cc6179f93e17 on hv-cinder-79760 Jul 05 21:01:13.575918 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [req-03f0d497-e138-45dd-8ce0-fb905f5c84af req-5ca9afcd-90e1-4160-a9db-b7bf6ad5a742 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041271 Jul 05 21:01:13.576643 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 371/760] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 5 21:01:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 21:01:13.582585 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-8f8c30c6-e9a5-45c4-bb2f-3e024c7dd5cf tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] [instance: 7b18289e-137f-467c-96ec-cc6179f93e17] Going to try to terminate instance {{(pid=117628) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 05 21:01:13.657803 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-8f8c30c6-e9a5-45c4-bb2f-3e024c7dd5cf tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] 10.222.0.20 "DELETE /compute/v2.1/servers/7b18289e-137f-467c-96ec-cc6179f93e17" status: 204 len: 0 microversion: 2.1 time: 0.128236 Jul 05 21:01:13.658894 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 390/761] 10.222.0.20 () {58 vars in 1238 bytes} [Tue Jul 5 21:01:13 2022] DELETE /compute/v2.1/servers/7b18289e-137f-467c-96ec-cc6179f93e17 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 05 21:01:13.667447 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-08c095c9-ef64-4b9f-87f3-a07dd0739428 tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 21:01:13.668131 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-08c095c9-ef64-4b9f-87f3-a07dd0739428 tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] [instance: 7b18289e-137f-467c-96ec-cc6179f93e17] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 21:01:13.675037 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-08c095c9-ef64-4b9f-87f3-a07dd0739428 tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:01:13.675478 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-08c095c9-ef64-4b9f-87f3-a07dd0739428 tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:01:13.676226 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-08c095c9-ef64-4b9f-87f3-a07dd0739428 tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:01:13.676651 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-08c095c9-ef64-4b9f-87f3-a07dd0739428 tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:01:13.824352 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-08c095c9-ef64-4b9f-87f3-a07dd0739428 tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a4b471d14044069a5969e8bc6ca4f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3429e99ac2a94266b152e053bc6a0006', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 21:01:13.832860 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-08c095c9-ef64-4b9f-87f3-a07dd0739428 tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] 10.222.0.20 "GET /compute/v2.1/servers/7b18289e-137f-467c-96ec-cc6179f93e17" status: 200 len: 1567 microversion: 2.1 time: 0.169460 Jul 05 21:01:13.833550 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 372/762] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 21:01:13 2022] GET /compute/v2.1/servers/7b18289e-137f-467c-96ec-cc6179f93e17 => generated 1567 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 21:01:14.177813 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-52e6cce7-3da4-4951-9bc4-8953fc486a12 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 21:01:14.178851 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-52e6cce7-3da4-4951-9bc4-8953fc486a12 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] [instance: 1b6eabe8-54b0-43cf-94ff-9d4abc8168db] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 21:01:14.185023 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-52e6cce7-3da4-4951-9bc4-8953fc486a12 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:01:14.185539 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-52e6cce7-3da4-4951-9bc4-8953fc486a12 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:01:14.186537 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-52e6cce7-3da4-4951-9bc4-8953fc486a12 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:01:14.187049 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-52e6cce7-3da4-4951-9bc4-8953fc486a12 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:01:14.336315 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-52e6cce7-3da4-4951-9bc4-8953fc486a12 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 21:01:14.345605 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-52e6cce7-3da4-4951-9bc4-8953fc486a12 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 21:01:14.348333 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-52e6cce7-3da4-4951-9bc4-8953fc486a12 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 21:01:14.349596 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-52e6cce7-3da4-4951-9bc4-8953fc486a12 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] 10.222.0.20 "GET /compute/v2.1/servers/1b6eabe8-54b0-43cf-94ff-9d4abc8168db" status: 200 len: 1719 microversion: 2.20 time: 0.175969 Jul 05 21:01:14.350434 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 391/763] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 5 21:01:14 2022] GET /compute/v2.1/servers/1b6eabe8-54b0-43cf-94ff-9d4abc8168db => generated 1719 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 21:01:14.851525 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-4044996b-9131-44bb-95c0-fffe00f97172 tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 21:01:14.852412 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-4044996b-9131-44bb-95c0-fffe00f97172 tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] [instance: 7b18289e-137f-467c-96ec-cc6179f93e17] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 21:01:14.860381 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-4044996b-9131-44bb-95c0-fffe00f97172 tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:01:14.860820 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-4044996b-9131-44bb-95c0-fffe00f97172 tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:01:14.862494 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-4044996b-9131-44bb-95c0-fffe00f97172 tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:01:14.862908 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-4044996b-9131-44bb-95c0-fffe00f97172 tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:01:14.998886 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-4044996b-9131-44bb-95c0-fffe00f97172 tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a4b471d14044069a5969e8bc6ca4f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3429e99ac2a94266b152e053bc6a0006', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 21:01:15.007791 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-4044996b-9131-44bb-95c0-fffe00f97172 tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] 10.222.0.20 "GET /compute/v2.1/servers/7b18289e-137f-467c-96ec-cc6179f93e17" status: 200 len: 1567 microversion: 2.1 time: 0.160486 Jul 05 21:01:15.008371 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 373/764] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 21:01:14 2022] GET /compute/v2.1/servers/7b18289e-137f-467c-96ec-cc6179f93e17 => generated 1567 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 21:01:15.368238 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-521ed244-9183-439a-b72f-b32a8e983760 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 21:01:15.368989 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-521ed244-9183-439a-b72f-b32a8e983760 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] [instance: 1b6eabe8-54b0-43cf-94ff-9d4abc8168db] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 21:01:15.376137 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-521ed244-9183-439a-b72f-b32a8e983760 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:01:15.376589 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-521ed244-9183-439a-b72f-b32a8e983760 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:01:15.378003 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-521ed244-9183-439a-b72f-b32a8e983760 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:01:15.378446 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-521ed244-9183-439a-b72f-b32a8e983760 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:01:15.445368 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-521ed244-9183-439a-b72f-b32a8e983760 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 21:01:15.453705 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-521ed244-9183-439a-b72f-b32a8e983760 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 21:01:15.455283 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-521ed244-9183-439a-b72f-b32a8e983760 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 21:01:15.456711 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-521ed244-9183-439a-b72f-b32a8e983760 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] 10.222.0.20 "GET /compute/v2.1/servers/1b6eabe8-54b0-43cf-94ff-9d4abc8168db" status: 200 len: 1652 microversion: 2.20 time: 0.092481 Jul 05 21:01:15.457523 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 392/765] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 5 21:01:15 2022] GET /compute/v2.1/servers/1b6eabe8-54b0-43cf-94ff-9d4abc8168db => generated 1652 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 21:01:15.590613 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [req-a6d0c644-0281-4eec-b4ed-4838f8bd3062 req-f7579268-65e6-4dfa-bb75-5a3fa5a5ca06 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b6eabe8-54b0-43cf-94ff-9d4abc8168db", "name": "network-vif-deleted", "tag": "15ebde2f-b2f2-42b3-a2d3-10634ee149d4"}]} {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 21:01:15.599382 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [req-a6d0c644-0281-4eec-b4ed-4838f8bd3062 req-f7579268-65e6-4dfa-bb75-5a3fa5a5ca06 service nova] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:01:15.599911 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [req-a6d0c644-0281-4eec-b4ed-4838f8bd3062 req-f7579268-65e6-4dfa-bb75-5a3fa5a5ca06 service nova] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:01:15.611128 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.compute.server_external_events [req-a6d0c644-0281-4eec-b4ed-4838f8bd3062 req-f7579268-65e6-4dfa-bb75-5a3fa5a5ca06 service nova] Creating event network-vif-deleted:15ebde2f-b2f2-42b3-a2d3-10634ee149d4 for instance 1b6eabe8-54b0-43cf-94ff-9d4abc8168db on hv-cinder-79760 Jul 05 21:01:15.617195 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [req-a6d0c644-0281-4eec-b4ed-4838f8bd3062 req-f7579268-65e6-4dfa-bb75-5a3fa5a5ca06 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030195 Jul 05 21:01:15.617796 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 374/766] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 5 21:01:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 21:01:16.025122 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-d225b49f-cb83-49e4-b1f9-09247c3f0d8a tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 21:01:16.025730 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-d225b49f-cb83-49e4-b1f9-09247c3f0d8a tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] [instance: 7b18289e-137f-467c-96ec-cc6179f93e17] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 21:01:16.032079 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-d225b49f-cb83-49e4-b1f9-09247c3f0d8a tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:01:16.032515 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-d225b49f-cb83-49e4-b1f9-09247c3f0d8a tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:01:16.034197 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-d225b49f-cb83-49e4-b1f9-09247c3f0d8a tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:01:16.034688 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-d225b49f-cb83-49e4-b1f9-09247c3f0d8a tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:01:16.187344 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-d225b49f-cb83-49e4-b1f9-09247c3f0d8a tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a4b471d14044069a5969e8bc6ca4f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3429e99ac2a94266b152e053bc6a0006', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 21:01:16.196271 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-d225b49f-cb83-49e4-b1f9-09247c3f0d8a tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] 10.222.0.20 "GET /compute/v2.1/servers/7b18289e-137f-467c-96ec-cc6179f93e17" status: 200 len: 1567 microversion: 2.1 time: 0.174995 Jul 05 21:01:16.197175 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 393/767] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 21:01:16 2022] GET /compute/v2.1/servers/7b18289e-137f-467c-96ec-cc6179f93e17 => generated 1567 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 21:01:16.475586 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-c768b3ea-028a-4f1f-b873-646ea8e62a21 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 21:01:16.476263 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-c768b3ea-028a-4f1f-b873-646ea8e62a21 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] [instance: 1b6eabe8-54b0-43cf-94ff-9d4abc8168db] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 21:01:16.482955 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-c768b3ea-028a-4f1f-b873-646ea8e62a21 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:01:16.483391 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-c768b3ea-028a-4f1f-b873-646ea8e62a21 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:01:16.484130 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-c768b3ea-028a-4f1f-b873-646ea8e62a21 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:01:16.484558 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-c768b3ea-028a-4f1f-b873-646ea8e62a21 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:01:16.551785 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-c768b3ea-028a-4f1f-b873-646ea8e62a21 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 21:01:16.560203 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-c768b3ea-028a-4f1f-b873-646ea8e62a21 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 21:01:16.561729 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-c768b3ea-028a-4f1f-b873-646ea8e62a21 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3792881ae73408db651dd6eb09b3d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fb5bc86604f38b5f0f3a46525189a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 21:01:16.562866 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-c768b3ea-028a-4f1f-b873-646ea8e62a21 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] 10.222.0.20 "GET /compute/v2.1/servers/1b6eabe8-54b0-43cf-94ff-9d4abc8168db" status: 200 len: 1652 microversion: 2.20 time: 0.091653 Jul 05 21:01:16.563415 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 375/768] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 5 21:01:16 2022] GET /compute/v2.1/servers/1b6eabe8-54b0-43cf-94ff-9d4abc8168db => generated 1652 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 21:01:17.214610 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-4669559e-ac42-4973-9d7b-599b01c891a8 tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 21:01:17.215243 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-4669559e-ac42-4973-9d7b-599b01c891a8 tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] [instance: 7b18289e-137f-467c-96ec-cc6179f93e17] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 21:01:17.222300 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-4669559e-ac42-4973-9d7b-599b01c891a8 tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:01:17.222734 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-4669559e-ac42-4973-9d7b-599b01c891a8 tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:01:17.223485 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-4669559e-ac42-4973-9d7b-599b01c891a8 tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:01:17.223906 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-4669559e-ac42-4973-9d7b-599b01c891a8 tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:01:17.359809 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-4669559e-ac42-4973-9d7b-599b01c891a8 tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a4b471d14044069a5969e8bc6ca4f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3429e99ac2a94266b152e053bc6a0006', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 21:01:17.367856 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-4669559e-ac42-4973-9d7b-599b01c891a8 tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] 10.222.0.20 "GET /compute/v2.1/servers/7b18289e-137f-467c-96ec-cc6179f93e17" status: 200 len: 1567 microversion: 2.1 time: 0.157319 Jul 05 21:01:17.374442 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 394/769] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 21:01:17 2022] GET /compute/v2.1/servers/7b18289e-137f-467c-96ec-cc6179f93e17 => generated 1567 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 21:01:17.586737 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-cb9cf00f-0604-4fc5-a2c8-ea16c4722634 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 21:01:17.587555 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-cb9cf00f-0604-4fc5-a2c8-ea16c4722634 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] [instance: 1b6eabe8-54b0-43cf-94ff-9d4abc8168db] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 21:01:17.594726 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-cb9cf00f-0604-4fc5-a2c8-ea16c4722634 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:01:17.595306 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-cb9cf00f-0604-4fc5-a2c8-ea16c4722634 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:01:17.596949 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-cb9cf00f-0604-4fc5-a2c8-ea16c4722634 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:01:17.597642 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-cb9cf00f-0604-4fc5-a2c8-ea16c4722634 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:01:17.612669 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.wsgi [None req-cb9cf00f-0604-4fc5-a2c8-ea16c4722634 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] HTTP exception thrown: Instance 1b6eabe8-54b0-43cf-94ff-9d4abc8168db could not be found. Jul 05 21:01:17.614537 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-cb9cf00f-0604-4fc5-a2c8-ea16c4722634 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Request method failure captured: Jul 05 21:01:17.614537 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: request: GET /compute/v2.1/servers/1b6eabe8-54b0-43cf-94ff-9d4abc8168db HTTP/1.1 Jul 05 21:01:17.614537 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: Accept: application/json Jul 05 21:01:17.614537 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: Accept-Encoding: identity Jul 05 21:01:17.614537 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: Connection: close Jul 05 21:01:17.614537 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: Content-Length: 0 Jul 05 21:01:17.614537 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: Content-Type: application/json Jul 05 21:01:17.614537 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: Host: 10.222.0.20 Jul 05 21:01:17.614537 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: Openstack-System-Scope: None Jul 05 21:01:17.614537 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: User-Agent: python-urllib3/1.26.9 Jul 05 21:01:17.614537 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Auth-Token: gAAAAABixKUR25VIYHsot9Ld9h0oSehn7jV7VQkY3bDP_S3_DD7TL5sllffAs82iRo_Pp9DAqOpRwVdCXf-pQX1WqAobGh_RJfgUIlk6hFuqLOQC26Jq7oia9tDs5qiVjC7bNCK_FbmEhr5Yo88V-Wa2dbpmXliHP6WKbgdZxjOWFB2oY--nsJk Jul 05 21:01:17.614537 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Domain-Id: None Jul 05 21:01:17.614537 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Domain-Name: None Jul 05 21:01:17.614537 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Identity-Status: Confirmed Jul 05 21:01:17.614537 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Is-Admin-Project: True Jul 05 21:01:17.614537 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Openstack-Nova-Api-Version: 2.20 Jul 05 21:01:17.614537 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Project-Domain-Id: default Jul 05 21:01:17.614537 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Project-Domain-Name: Default Jul 05 21:01:17.614537 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Project-Id: 9c5fb5bc86604f38b5f0f3a46525189a Jul 05 21:01:17.614537 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2043655930 Jul 05 21:01:17.614537 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Role: member,reader Jul 05 21:01:17.614537 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Roles: member,reader Jul 05 21:01:17.616803 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9c5fb5bc86604f38b5f0f3a46525189a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/9c5fb5bc86604f38b5f0f3a46525189a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_9c5fb5bc86604f38b5f0f3a46525189a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9c5fb5bc86604f38b5f0f3a46525189a"}]}] Jul 05 21:01:17.616803 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2043655930 Jul 05 21:01:17.616803 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Tenant-Id: 9c5fb5bc86604f38b5f0f3a46525189a Jul 05 21:01:17.616803 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2043655930 Jul 05 21:01:17.616803 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-User: tempest-AttachVolumeShelveTestJSON-2043655930-project Jul 05 21:01:17.616803 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-User-Domain-Id: default Jul 05 21:01:17.616803 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-User-Domain-Name: Default Jul 05 21:01:17.616803 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-User-Id: a3792881ae73408db651dd6eb09b3d25 Jul 05 21:01:17.616803 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2043655930-project Jul 05 21:01:17.616803 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: method: > Jul 05 21:01:17.616803 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: exception: Instance 1b6eabe8-54b0-43cf-94ff-9d4abc8168db could not be found. Jul 05 21:01:17.616803 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: action_args: {'id': '1b6eabe8-54b0-43cf-94ff-9d4abc8168db'} Jul 05 21:01:17.618293 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 05 21:01:17.618293 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 21:01:17.618293 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 05 21:01:17.618293 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 05 21:01:17.618293 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 05 21:01:17.618293 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 05 21:01:17.618293 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 05 21:01:17.618293 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 05 21:01:17.618293 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 05 21:01:17.618293 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 05 21:01:17.618293 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1b6eabe8-54b0-43cf-94ff-9d4abc8168db could not be found. Jul 05 21:01:17.618293 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi Jul 05 21:01:17.618293 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 21:01:17.618293 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi Jul 05 21:01:17.618293 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 21:01:17.618293 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 21:01:17.618293 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 21:01:17.618293 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 05 21:01:17.618293 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 05 21:01:17.618293 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 05 21:01:17.619760 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 05 21:01:17.619760 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 05 21:01:17.619760 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 05 21:01:17.619760 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 05 21:01:17.619760 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 05 21:01:17.619760 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 05 21:01:17.619760 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 05 21:01:17.619760 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1b6eabe8-54b0-43cf-94ff-9d4abc8168db could not be found. Jul 05 21:01:17.619760 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi Jul 05 21:01:17.619760 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 21:01:17.619760 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi Jul 05 21:01:17.619760 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 21:01:17.619760 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 21:01:17.619760 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 21:01:17.619760 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 05 21:01:17.619760 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 05 21:01:17.619760 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1b6eabe8-54b0-43cf-94ff-9d4abc8168db could not be found. Jul 05 21:01:17.619760 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi Jul 05 21:01:17.621103 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-cb9cf00f-0604-4fc5-a2c8-ea16c4722634 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Returning 404 to user: Instance 1b6eabe8-54b0-43cf-94ff-9d4abc8168db could not be found. {{(pid=117627) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 05 21:01:17.621103 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-cb9cf00f-0604-4fc5-a2c8-ea16c4722634 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] 10.222.0.20 "GET /compute/v2.1/servers/1b6eabe8-54b0-43cf-94ff-9d4abc8168db" status: 404 len: 111 microversion: 2.20 time: 0.039887 Jul 05 21:01:17.624963 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 376/770] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 5 21:01:17 2022] GET /compute/v2.1/servers/1b6eabe8-54b0-43cf-94ff-9d4abc8168db => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 05 21:01:17.629922 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-a3e3ff32-a636-4efa-9e16-6d97317619e8 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Calling method '.version_select at 0x7f57ce0df040>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 21:01:17.652770 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-a3e3ff32-a636-4efa-9e16-6d97317619e8 tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-4791681" status: 204 len: 0 microversion: 2.20 time: 0.026169 Jul 05 21:01:17.656915 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 395/771] 10.222.0.20 () {60 vars in 1252 bytes} [Tue Jul 5 21:01:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-4791681 => generated 0 bytes in 28 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jul 05 21:01:18.015961 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [req-20300e54-32bd-4728-940d-2c7b6e741009 req-4c32e987-ad6c-4e29-938f-52f1601121a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b18289e-137f-467c-96ec-cc6179f93e17", "name": "network-vif-deleted", "tag": "6b603e35-d2c5-47fc-83a0-12c2780e086f"}]} {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 21:01:18.026268 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [req-20300e54-32bd-4728-940d-2c7b6e741009 req-4c32e987-ad6c-4e29-938f-52f1601121a8 service nova] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:01:18.026658 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [req-20300e54-32bd-4728-940d-2c7b6e741009 req-4c32e987-ad6c-4e29-938f-52f1601121a8 service nova] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:01:18.039267 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.compute.server_external_events [req-20300e54-32bd-4728-940d-2c7b6e741009 req-4c32e987-ad6c-4e29-938f-52f1601121a8 service nova] Creating event network-vif-deleted:6b603e35-d2c5-47fc-83a0-12c2780e086f for instance 7b18289e-137f-467c-96ec-cc6179f93e17 on hv-cinder-79760 Jul 05 21:01:18.044802 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [req-20300e54-32bd-4728-940d-2c7b6e741009 req-4c32e987-ad6c-4e29-938f-52f1601121a8 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033091 Jul 05 21:01:18.045473 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 377/772] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 5 21:01:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 21:01:18.397691 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-f4f2d0fc-a1dc-434f-935b-810dae18ab9d tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 21:01:18.398923 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-f4f2d0fc-a1dc-434f-935b-810dae18ab9d tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] [instance: 7b18289e-137f-467c-96ec-cc6179f93e17] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 21:01:18.407622 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-f4f2d0fc-a1dc-434f-935b-810dae18ab9d tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:01:18.408915 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-f4f2d0fc-a1dc-434f-935b-810dae18ab9d tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:01:18.410175 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-f4f2d0fc-a1dc-434f-935b-810dae18ab9d tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:01:18.411786 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-f4f2d0fc-a1dc-434f-935b-810dae18ab9d tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:01:18.496674 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-f4f2d0fc-a1dc-434f-935b-810dae18ab9d tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a4b471d14044069a5969e8bc6ca4f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3429e99ac2a94266b152e053bc6a0006', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 21:01:18.520294 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-f4f2d0fc-a1dc-434f-935b-810dae18ab9d tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] 10.222.0.20 "GET /compute/v2.1/servers/7b18289e-137f-467c-96ec-cc6179f93e17" status: 200 len: 1219 microversion: 2.1 time: 0.132066 Jul 05 21:01:18.522385 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 396/773] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 21:01:18 2022] GET /compute/v2.1/servers/7b18289e-137f-467c-96ec-cc6179f93e17 => generated 1219 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 21:01:19.540485 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-e35cde4d-ac6f-472b-a1fa-23969d771054 tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 21:01:19.541437 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-e35cde4d-ac6f-472b-a1fa-23969d771054 tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] [instance: 7b18289e-137f-467c-96ec-cc6179f93e17] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 21:01:19.548145 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-e35cde4d-ac6f-472b-a1fa-23969d771054 tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:01:19.548595 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-e35cde4d-ac6f-472b-a1fa-23969d771054 tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:01:19.549442 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-e35cde4d-ac6f-472b-a1fa-23969d771054 tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:01:19.549873 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-e35cde4d-ac6f-472b-a1fa-23969d771054 tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:01:19.565758 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.wsgi [None req-e35cde4d-ac6f-472b-a1fa-23969d771054 tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] HTTP exception thrown: Instance 7b18289e-137f-467c-96ec-cc6179f93e17 could not be found. Jul 05 21:01:19.567394 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-e35cde4d-ac6f-472b-a1fa-23969d771054 tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Request method failure captured: Jul 05 21:01:19.567394 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: request: GET /compute/v2.1/servers/7b18289e-137f-467c-96ec-cc6179f93e17 HTTP/1.1 Jul 05 21:01:19.567394 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: Accept: application/json Jul 05 21:01:19.567394 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: Accept-Encoding: identity Jul 05 21:01:19.567394 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: Connection: close Jul 05 21:01:19.567394 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: Content-Length: 0 Jul 05 21:01:19.567394 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: Content-Type: application/json Jul 05 21:01:19.567394 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: Host: 10.222.0.20 Jul 05 21:01:19.567394 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: Openstack-System-Scope: None Jul 05 21:01:19.567394 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: User-Agent: python-urllib3/1.26.9 Jul 05 21:01:19.567394 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Auth-Token: gAAAAABixKVOyJPFz4E98pkYlKCiPNfOWQLe0G_uYRN5Y4uHXZVMI_6POFXWoklZw7zUVlwaLUTupyJalIhLl_qhONv5U77ETfp8lzlvpPkWQA3XMIXJOHDXHTtSCCCUbO13ZCXQdGL2jqqoD38pCaSUHOhIWLPJ9Xguk0MIVzJ2fHDWrPXp6vQ Jul 05 21:01:19.567394 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Domain-Id: None Jul 05 21:01:19.567394 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Domain-Name: None Jul 05 21:01:19.567394 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Identity-Status: Confirmed Jul 05 21:01:19.567394 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Is-Admin-Project: True Jul 05 21:01:19.567394 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Project-Domain-Id: default Jul 05 21:01:19.567394 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Project-Domain-Name: Default Jul 05 21:01:19.567394 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Project-Id: 3429e99ac2a94266b152e053bc6a0006 Jul 05 21:01:19.567394 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Project-Name: tempest-TestShelveInstance-234599529 Jul 05 21:01:19.567394 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Role: member,reader Jul 05 21:01:19.567394 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Roles: member,reader Jul 05 21:01:19.568995 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3429e99ac2a94266b152e053bc6a0006"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/3429e99ac2a94266b152e053bc6a0006"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_3429e99ac2a94266b152e053bc6a0006"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3429e99ac2a94266b152e053bc6a0006"}]}] Jul 05 21:01:19.568995 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Tenant: tempest-TestShelveInstance-234599529 Jul 05 21:01:19.568995 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Tenant-Id: 3429e99ac2a94266b152e053bc6a0006 Jul 05 21:01:19.568995 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Tenant-Name: tempest-TestShelveInstance-234599529 Jul 05 21:01:19.568995 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-User: tempest-TestShelveInstance-234599529-project Jul 05 21:01:19.568995 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-User-Domain-Id: default Jul 05 21:01:19.568995 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-User-Domain-Name: Default Jul 05 21:01:19.568995 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-User-Id: 7a4b471d14044069a5969e8bc6ca4f2d Jul 05 21:01:19.568995 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-User-Name: tempest-TestShelveInstance-234599529-project Jul 05 21:01:19.568995 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: method: > Jul 05 21:01:19.568995 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: exception: Instance 7b18289e-137f-467c-96ec-cc6179f93e17 could not be found. Jul 05 21:01:19.568995 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: action_args: {'id': '7b18289e-137f-467c-96ec-cc6179f93e17'} Jul 05 21:01:19.573594 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 05 21:01:19.573594 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 21:01:19.573594 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 05 21:01:19.573594 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 05 21:01:19.573594 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 05 21:01:19.573594 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 05 21:01:19.573594 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 05 21:01:19.573594 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 05 21:01:19.573594 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 05 21:01:19.573594 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 05 21:01:19.573594 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7b18289e-137f-467c-96ec-cc6179f93e17 could not be found. Jul 05 21:01:19.573594 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi Jul 05 21:01:19.573594 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 21:01:19.573594 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi Jul 05 21:01:19.573594 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 21:01:19.573594 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 21:01:19.573594 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 21:01:19.573594 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 05 21:01:19.573594 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 05 21:01:19.573594 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 05 21:01:19.575733 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 05 21:01:19.575733 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 05 21:01:19.575733 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 05 21:01:19.575733 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 05 21:01:19.575733 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 05 21:01:19.575733 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 05 21:01:19.575733 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 05 21:01:19.575733 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7b18289e-137f-467c-96ec-cc6179f93e17 could not be found. Jul 05 21:01:19.575733 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi Jul 05 21:01:19.575733 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 21:01:19.575733 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi Jul 05 21:01:19.575733 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 21:01:19.575733 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 21:01:19.575733 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 21:01:19.575733 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 05 21:01:19.575733 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 05 21:01:19.575733 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7b18289e-137f-467c-96ec-cc6179f93e17 could not be found. Jul 05 21:01:19.575733 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi Jul 05 21:01:19.577610 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-e35cde4d-ac6f-472b-a1fa-23969d771054 tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Returning 404 to user: Instance 7b18289e-137f-467c-96ec-cc6179f93e17 could not be found. {{(pid=117627) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 05 21:01:19.577610 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-e35cde4d-ac6f-472b-a1fa-23969d771054 tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] 10.222.0.20 "GET /compute/v2.1/servers/7b18289e-137f-467c-96ec-cc6179f93e17" status: 404 len: 111 microversion: 2.1 time: 0.032994 Jul 05 21:01:19.577610 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 378/774] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 21:01:19 2022] GET /compute/v2.1/servers/7b18289e-137f-467c-96ec-cc6179f93e17 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 05 21:01:19.695174 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-07965078-17c3-4a40-8c79-c94d10c2753a tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 21:01:19.695828 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-07965078-17c3-4a40-8c79-c94d10c2753a tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] [instance: 1b6eabe8-54b0-43cf-94ff-9d4abc8168db] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 21:01:19.703358 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-07965078-17c3-4a40-8c79-c94d10c2753a tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:01:19.703887 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-07965078-17c3-4a40-8c79-c94d10c2753a tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:01:19.704678 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-07965078-17c3-4a40-8c79-c94d10c2753a tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:01:19.705864 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-07965078-17c3-4a40-8c79-c94d10c2753a tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:01:19.723878 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.wsgi [None req-07965078-17c3-4a40-8c79-c94d10c2753a tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] HTTP exception thrown: Instance 1b6eabe8-54b0-43cf-94ff-9d4abc8168db could not be found. Jul 05 21:01:19.729787 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-07965078-17c3-4a40-8c79-c94d10c2753a tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Request method failure captured: Jul 05 21:01:19.729787 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: request: DELETE /compute/v2.1/servers/1b6eabe8-54b0-43cf-94ff-9d4abc8168db HTTP/1.1 Jul 05 21:01:19.729787 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: Accept: application/json Jul 05 21:01:19.729787 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: Accept-Encoding: identity Jul 05 21:01:19.729787 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: Connection: close Jul 05 21:01:19.729787 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: Content-Length: 0 Jul 05 21:01:19.729787 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: Content-Type: application/json Jul 05 21:01:19.729787 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: Host: 10.222.0.20 Jul 05 21:01:19.729787 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: Openstack-System-Scope: None Jul 05 21:01:19.729787 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: User-Agent: python-urllib3/1.26.9 Jul 05 21:01:19.729787 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Auth-Token: gAAAAABixKUR25VIYHsot9Ld9h0oSehn7jV7VQkY3bDP_S3_DD7TL5sllffAs82iRo_Pp9DAqOpRwVdCXf-pQX1WqAobGh_RJfgUIlk6hFuqLOQC26Jq7oia9tDs5qiVjC7bNCK_FbmEhr5Yo88V-Wa2dbpmXliHP6WKbgdZxjOWFB2oY--nsJk Jul 05 21:01:19.729787 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Domain-Id: None Jul 05 21:01:19.729787 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Domain-Name: None Jul 05 21:01:19.729787 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Identity-Status: Confirmed Jul 05 21:01:19.729787 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Is-Admin-Project: True Jul 05 21:01:19.729787 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Openstack-Nova-Api-Version: 2.20 Jul 05 21:01:19.729787 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Project-Domain-Id: default Jul 05 21:01:19.729787 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Project-Domain-Name: Default Jul 05 21:01:19.729787 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Project-Id: 9c5fb5bc86604f38b5f0f3a46525189a Jul 05 21:01:19.729787 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2043655930 Jul 05 21:01:19.729787 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Role: member,reader Jul 05 21:01:19.729787 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Roles: member,reader Jul 05 21:01:19.731304 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9c5fb5bc86604f38b5f0f3a46525189a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/9c5fb5bc86604f38b5f0f3a46525189a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_9c5fb5bc86604f38b5f0f3a46525189a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9c5fb5bc86604f38b5f0f3a46525189a"}]}] Jul 05 21:01:19.731304 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2043655930 Jul 05 21:01:19.731304 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Tenant-Id: 9c5fb5bc86604f38b5f0f3a46525189a Jul 05 21:01:19.731304 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2043655930 Jul 05 21:01:19.731304 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-User: tempest-AttachVolumeShelveTestJSON-2043655930-project Jul 05 21:01:19.731304 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-User-Domain-Id: default Jul 05 21:01:19.731304 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-User-Domain-Name: Default Jul 05 21:01:19.731304 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-User-Id: a3792881ae73408db651dd6eb09b3d25 Jul 05 21:01:19.731304 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2043655930-project Jul 05 21:01:19.731304 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: method: > Jul 05 21:01:19.731304 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: exception: Instance 1b6eabe8-54b0-43cf-94ff-9d4abc8168db could not be found. Jul 05 21:01:19.731304 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: action_args: {'id': '1b6eabe8-54b0-43cf-94ff-9d4abc8168db'} Jul 05 21:01:19.732055 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 05 21:01:19.732055 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 21:01:19.732055 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 05 21:01:19.732055 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 05 21:01:19.732055 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 05 21:01:19.732055 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 05 21:01:19.732055 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 05 21:01:19.732055 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 05 21:01:19.732055 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 05 21:01:19.732055 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 05 21:01:19.732055 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1b6eabe8-54b0-43cf-94ff-9d4abc8168db could not be found. Jul 05 21:01:19.732055 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi Jul 05 21:01:19.732055 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 21:01:19.732055 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi Jul 05 21:01:19.732055 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 21:01:19.732055 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 21:01:19.732055 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 21:01:19.732055 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 05 21:01:19.732055 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 05 21:01:19.732055 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 05 21:01:19.734430 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 05 21:01:19.734430 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 05 21:01:19.734430 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 05 21:01:19.734430 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 05 21:01:19.734430 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 05 21:01:19.734430 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 05 21:01:19.734430 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 05 21:01:19.734430 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 05 21:01:19.734430 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 05 21:01:19.734430 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1b6eabe8-54b0-43cf-94ff-9d4abc8168db could not be found. Jul 05 21:01:19.734430 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi Jul 05 21:01:19.734430 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 21:01:19.734430 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi Jul 05 21:01:19.734430 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 21:01:19.734430 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 21:01:19.734430 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 21:01:19.734430 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 05 21:01:19.734430 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 05 21:01:19.734430 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1b6eabe8-54b0-43cf-94ff-9d4abc8168db could not be found. Jul 05 21:01:19.734430 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi Jul 05 21:01:19.736034 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-07965078-17c3-4a40-8c79-c94d10c2753a tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Returning 404 to user: Instance 1b6eabe8-54b0-43cf-94ff-9d4abc8168db could not be found. {{(pid=117628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 05 21:01:19.736034 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-07965078-17c3-4a40-8c79-c94d10c2753a tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] 10.222.0.20 "DELETE /compute/v2.1/servers/1b6eabe8-54b0-43cf-94ff-9d4abc8168db" status: 404 len: 111 microversion: 2.20 time: 0.040465 Jul 05 21:01:19.736034 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 397/775] 10.222.0.20 () {60 vars in 1279 bytes} [Tue Jul 5 21:01:19 2022] DELETE /compute/v2.1/servers/1b6eabe8-54b0-43cf-94ff-9d4abc8168db => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 05 21:01:19.743256 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-9ed1a214-b6c3-4a2e-945b-180c3326a01f tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 21:01:19.744248 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-9ed1a214-b6c3-4a2e-945b-180c3326a01f tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] [instance: 1b6eabe8-54b0-43cf-94ff-9d4abc8168db] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 21:01:19.751443 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-9ed1a214-b6c3-4a2e-945b-180c3326a01f tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:01:19.751964 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-9ed1a214-b6c3-4a2e-945b-180c3326a01f tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:01:19.753187 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-9ed1a214-b6c3-4a2e-945b-180c3326a01f tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:01:19.753640 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-9ed1a214-b6c3-4a2e-945b-180c3326a01f tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:01:19.771059 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-68d44217-3a31-4fc0-bd3b-4a0be8efb9b1 tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] Calling method '.version_select at 0x7f57cdf89820>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 21:01:19.784346 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.wsgi [None req-9ed1a214-b6c3-4a2e-945b-180c3326a01f tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] HTTP exception thrown: Instance 1b6eabe8-54b0-43cf-94ff-9d4abc8168db could not be found. Jul 05 21:01:19.786025 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-9ed1a214-b6c3-4a2e-945b-180c3326a01f tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Request method failure captured: Jul 05 21:01:19.786025 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: request: GET /compute/v2.1/servers/1b6eabe8-54b0-43cf-94ff-9d4abc8168db HTTP/1.1 Jul 05 21:01:19.786025 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: Accept: application/json Jul 05 21:01:19.786025 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: Accept-Encoding: identity Jul 05 21:01:19.786025 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: Connection: close Jul 05 21:01:19.786025 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: Content-Length: 0 Jul 05 21:01:19.786025 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: Content-Type: application/json Jul 05 21:01:19.786025 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: Host: 10.222.0.20 Jul 05 21:01:19.786025 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: Openstack-System-Scope: None Jul 05 21:01:19.786025 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: User-Agent: python-urllib3/1.26.9 Jul 05 21:01:19.786025 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Auth-Token: gAAAAABixKUR25VIYHsot9Ld9h0oSehn7jV7VQkY3bDP_S3_DD7TL5sllffAs82iRo_Pp9DAqOpRwVdCXf-pQX1WqAobGh_RJfgUIlk6hFuqLOQC26Jq7oia9tDs5qiVjC7bNCK_FbmEhr5Yo88V-Wa2dbpmXliHP6WKbgdZxjOWFB2oY--nsJk Jul 05 21:01:19.786025 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Domain-Id: None Jul 05 21:01:19.786025 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Domain-Name: None Jul 05 21:01:19.786025 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Identity-Status: Confirmed Jul 05 21:01:19.786025 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Is-Admin-Project: True Jul 05 21:01:19.786025 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Openstack-Nova-Api-Version: 2.20 Jul 05 21:01:19.786025 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Project-Domain-Id: default Jul 05 21:01:19.786025 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Project-Domain-Name: Default Jul 05 21:01:19.786025 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Project-Id: 9c5fb5bc86604f38b5f0f3a46525189a Jul 05 21:01:19.786025 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2043655930 Jul 05 21:01:19.786025 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Role: member,reader Jul 05 21:01:19.786025 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Roles: member,reader Jul 05 21:01:19.787710 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9c5fb5bc86604f38b5f0f3a46525189a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/9c5fb5bc86604f38b5f0f3a46525189a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_9c5fb5bc86604f38b5f0f3a46525189a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9c5fb5bc86604f38b5f0f3a46525189a"}]}] Jul 05 21:01:19.787710 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2043655930 Jul 05 21:01:19.787710 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Tenant-Id: 9c5fb5bc86604f38b5f0f3a46525189a Jul 05 21:01:19.787710 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2043655930 Jul 05 21:01:19.787710 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-User: tempest-AttachVolumeShelveTestJSON-2043655930-project Jul 05 21:01:19.787710 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-User-Domain-Id: default Jul 05 21:01:19.787710 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-User-Domain-Name: Default Jul 05 21:01:19.787710 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-User-Id: a3792881ae73408db651dd6eb09b3d25 Jul 05 21:01:19.787710 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2043655930-project Jul 05 21:01:19.787710 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: method: > Jul 05 21:01:19.787710 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: exception: Instance 1b6eabe8-54b0-43cf-94ff-9d4abc8168db could not be found. Jul 05 21:01:19.787710 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: action_args: {'id': '1b6eabe8-54b0-43cf-94ff-9d4abc8168db'} Jul 05 21:01:19.788611 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 05 21:01:19.788611 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 21:01:19.788611 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 05 21:01:19.788611 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 05 21:01:19.788611 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 05 21:01:19.788611 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 05 21:01:19.788611 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 05 21:01:19.788611 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 05 21:01:19.788611 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 05 21:01:19.788611 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 05 21:01:19.788611 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1b6eabe8-54b0-43cf-94ff-9d4abc8168db could not be found. Jul 05 21:01:19.788611 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi Jul 05 21:01:19.788611 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 21:01:19.788611 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi Jul 05 21:01:19.788611 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 21:01:19.788611 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 21:01:19.788611 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 21:01:19.788611 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 05 21:01:19.788611 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 05 21:01:19.788611 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 05 21:01:19.790141 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 05 21:01:19.790141 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 05 21:01:19.790141 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 05 21:01:19.790141 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 05 21:01:19.790141 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 05 21:01:19.790141 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 05 21:01:19.790141 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 05 21:01:19.790141 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1b6eabe8-54b0-43cf-94ff-9d4abc8168db could not be found. Jul 05 21:01:19.790141 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi Jul 05 21:01:19.790141 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 21:01:19.790141 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi Jul 05 21:01:19.790141 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 21:01:19.790141 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 21:01:19.790141 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 21:01:19.790141 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 05 21:01:19.790141 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 05 21:01:19.790141 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1b6eabe8-54b0-43cf-94ff-9d4abc8168db could not be found. Jul 05 21:01:19.790141 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi Jul 05 21:01:19.791502 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-9ed1a214-b6c3-4a2e-945b-180c3326a01f tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Returning 404 to user: Instance 1b6eabe8-54b0-43cf-94ff-9d4abc8168db could not be found. {{(pid=117627) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 05 21:01:19.791502 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-9ed1a214-b6c3-4a2e-945b-180c3326a01f tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] 10.222.0.20 "GET /compute/v2.1/servers/1b6eabe8-54b0-43cf-94ff-9d4abc8168db" status: 404 len: 111 microversion: 2.20 time: 0.049927 Jul 05 21:01:19.791502 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 379/776] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 5 21:01:19 2022] GET /compute/v2.1/servers/1b6eabe8-54b0-43cf-94ff-9d4abc8168db => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 05 21:01:19.805788 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-68d44217-3a31-4fc0-bd3b-4a0be8efb9b1 tempest-TestShelveInstance-234599529 tempest-TestShelveInstance-234599529-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-672009384" status: 202 len: 0 microversion: 2.1 time: 0.042545 Jul 05 21:01:19.806855 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 398/777] 10.222.0.20 () {58 vars in 1250 bytes} [Tue Jul 5 21:01:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-672009384 => generated 0 bytes in 44 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 05 21:01:20.951022 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-ec9a8592-1f7f-4c4b-a135-ba53d354cbae tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 21:01:20.951702 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-ec9a8592-1f7f-4c4b-a135-ba53d354cbae tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] [instance: 52848078-62a1-484f-813c-7b3352cb3851] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 21:01:20.959346 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-ec9a8592-1f7f-4c4b-a135-ba53d354cbae tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:01:20.959925 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-ec9a8592-1f7f-4c4b-a135-ba53d354cbae tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:01:20.960872 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-ec9a8592-1f7f-4c4b-a135-ba53d354cbae tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:01:20.961533 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-ec9a8592-1f7f-4c4b-a135-ba53d354cbae tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:01:20.977081 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.wsgi [None req-ec9a8592-1f7f-4c4b-a135-ba53d354cbae tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] HTTP exception thrown: Instance 52848078-62a1-484f-813c-7b3352cb3851 could not be found. Jul 05 21:01:20.978783 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-ec9a8592-1f7f-4c4b-a135-ba53d354cbae tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Request method failure captured: Jul 05 21:01:20.978783 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: request: DELETE /compute/v2.1/servers/52848078-62a1-484f-813c-7b3352cb3851 HTTP/1.1 Jul 05 21:01:20.978783 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: Accept: application/json Jul 05 21:01:20.978783 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: Accept-Encoding: identity Jul 05 21:01:20.978783 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: Connection: close Jul 05 21:01:20.978783 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: Content-Length: 0 Jul 05 21:01:20.978783 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: Content-Type: application/json Jul 05 21:01:20.978783 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: Host: 10.222.0.20 Jul 05 21:01:20.978783 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: Openstack-System-Scope: None Jul 05 21:01:20.978783 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: User-Agent: python-urllib3/1.26.9 Jul 05 21:01:20.978783 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Auth-Token: gAAAAABixKUR25VIYHsot9Ld9h0oSehn7jV7VQkY3bDP_S3_DD7TL5sllffAs82iRo_Pp9DAqOpRwVdCXf-pQX1WqAobGh_RJfgUIlk6hFuqLOQC26Jq7oia9tDs5qiVjC7bNCK_FbmEhr5Yo88V-Wa2dbpmXliHP6WKbgdZxjOWFB2oY--nsJk Jul 05 21:01:20.978783 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Domain-Id: None Jul 05 21:01:20.978783 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Domain-Name: None Jul 05 21:01:20.978783 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Identity-Status: Confirmed Jul 05 21:01:20.978783 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Is-Admin-Project: True Jul 05 21:01:20.978783 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Openstack-Nova-Api-Version: 2.20 Jul 05 21:01:20.978783 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Project-Domain-Id: default Jul 05 21:01:20.978783 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Project-Domain-Name: Default Jul 05 21:01:20.978783 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Project-Id: 9c5fb5bc86604f38b5f0f3a46525189a Jul 05 21:01:20.978783 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2043655930 Jul 05 21:01:20.978783 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Role: member,reader Jul 05 21:01:20.978783 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Roles: member,reader Jul 05 21:01:20.980177 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9c5fb5bc86604f38b5f0f3a46525189a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/9c5fb5bc86604f38b5f0f3a46525189a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_9c5fb5bc86604f38b5f0f3a46525189a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9c5fb5bc86604f38b5f0f3a46525189a"}]}] Jul 05 21:01:20.980177 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2043655930 Jul 05 21:01:20.980177 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Tenant-Id: 9c5fb5bc86604f38b5f0f3a46525189a Jul 05 21:01:20.980177 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2043655930 Jul 05 21:01:20.980177 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-User: tempest-AttachVolumeShelveTestJSON-2043655930-project Jul 05 21:01:20.980177 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-User-Domain-Id: default Jul 05 21:01:20.980177 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-User-Domain-Name: Default Jul 05 21:01:20.980177 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-User-Id: a3792881ae73408db651dd6eb09b3d25 Jul 05 21:01:20.980177 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2043655930-project Jul 05 21:01:20.980177 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: method: > Jul 05 21:01:20.980177 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: exception: Instance 52848078-62a1-484f-813c-7b3352cb3851 could not be found. Jul 05 21:01:20.980177 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: action_args: {'id': '52848078-62a1-484f-813c-7b3352cb3851'} Jul 05 21:01:20.980914 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 05 21:01:20.980914 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 21:01:20.980914 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 05 21:01:20.980914 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 05 21:01:20.980914 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 05 21:01:20.980914 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 05 21:01:20.980914 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 05 21:01:20.980914 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 05 21:01:20.980914 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 05 21:01:20.980914 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 05 21:01:20.980914 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 52848078-62a1-484f-813c-7b3352cb3851 could not be found. Jul 05 21:01:20.980914 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi Jul 05 21:01:20.980914 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 21:01:20.980914 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi Jul 05 21:01:20.980914 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 21:01:20.980914 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 21:01:20.980914 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 21:01:20.980914 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 05 21:01:20.980914 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 05 21:01:20.980914 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 05 21:01:20.982181 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 05 21:01:20.982181 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 05 21:01:20.982181 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 05 21:01:20.982181 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 05 21:01:20.982181 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 05 21:01:20.982181 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 05 21:01:20.982181 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 05 21:01:20.982181 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 05 21:01:20.982181 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 05 21:01:20.982181 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 52848078-62a1-484f-813c-7b3352cb3851 could not be found. Jul 05 21:01:20.982181 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi Jul 05 21:01:20.982181 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 21:01:20.982181 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi Jul 05 21:01:20.982181 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 21:01:20.982181 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 21:01:20.982181 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 21:01:20.982181 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 05 21:01:20.982181 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 05 21:01:20.982181 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 52848078-62a1-484f-813c-7b3352cb3851 could not be found. Jul 05 21:01:20.982181 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi Jul 05 21:01:20.985031 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-ec9a8592-1f7f-4c4b-a135-ba53d354cbae tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Returning 404 to user: Instance 52848078-62a1-484f-813c-7b3352cb3851 could not be found. {{(pid=117627) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 05 21:01:20.986831 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-ec9a8592-1f7f-4c4b-a135-ba53d354cbae tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] 10.222.0.20 "DELETE /compute/v2.1/servers/52848078-62a1-484f-813c-7b3352cb3851" status: 404 len: 111 microversion: 2.20 time: 0.039281 Jul 05 21:01:20.987932 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 380/778] 10.222.0.20 () {60 vars in 1279 bytes} [Tue Jul 5 21:01:20 2022] DELETE /compute/v2.1/servers/52848078-62a1-484f-813c-7b3352cb3851 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 05 21:01:20.997870 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-2292a024-d994-46da-8f31-969276b7873d tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 21:01:20.998490 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-2292a024-d994-46da-8f31-969276b7873d tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] [instance: 52848078-62a1-484f-813c-7b3352cb3851] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 21:01:21.006281 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-2292a024-d994-46da-8f31-969276b7873d tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:01:21.007113 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-2292a024-d994-46da-8f31-969276b7873d tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:01:21.008050 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-2292a024-d994-46da-8f31-969276b7873d tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:01:21.008654 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-2292a024-d994-46da-8f31-969276b7873d tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:01:21.024809 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.wsgi [None req-2292a024-d994-46da-8f31-969276b7873d tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] HTTP exception thrown: Instance 52848078-62a1-484f-813c-7b3352cb3851 could not be found. Jul 05 21:01:21.026979 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-2292a024-d994-46da-8f31-969276b7873d tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Request method failure captured: Jul 05 21:01:21.026979 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: request: GET /compute/v2.1/servers/52848078-62a1-484f-813c-7b3352cb3851 HTTP/1.1 Jul 05 21:01:21.026979 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: Accept: application/json Jul 05 21:01:21.026979 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: Accept-Encoding: identity Jul 05 21:01:21.026979 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: Connection: close Jul 05 21:01:21.026979 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: Content-Length: 0 Jul 05 21:01:21.026979 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: Content-Type: application/json Jul 05 21:01:21.026979 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: Host: 10.222.0.20 Jul 05 21:01:21.026979 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: Openstack-System-Scope: None Jul 05 21:01:21.026979 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: User-Agent: python-urllib3/1.26.9 Jul 05 21:01:21.026979 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Auth-Token: gAAAAABixKUR25VIYHsot9Ld9h0oSehn7jV7VQkY3bDP_S3_DD7TL5sllffAs82iRo_Pp9DAqOpRwVdCXf-pQX1WqAobGh_RJfgUIlk6hFuqLOQC26Jq7oia9tDs5qiVjC7bNCK_FbmEhr5Yo88V-Wa2dbpmXliHP6WKbgdZxjOWFB2oY--nsJk Jul 05 21:01:21.026979 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Domain-Id: None Jul 05 21:01:21.026979 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Domain-Name: None Jul 05 21:01:21.026979 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Identity-Status: Confirmed Jul 05 21:01:21.026979 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Is-Admin-Project: True Jul 05 21:01:21.026979 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Openstack-Nova-Api-Version: 2.20 Jul 05 21:01:21.026979 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Project-Domain-Id: default Jul 05 21:01:21.026979 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Project-Domain-Name: Default Jul 05 21:01:21.026979 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Project-Id: 9c5fb5bc86604f38b5f0f3a46525189a Jul 05 21:01:21.026979 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2043655930 Jul 05 21:01:21.026979 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Role: member,reader Jul 05 21:01:21.026979 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Roles: member,reader Jul 05 21:01:21.028611 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9c5fb5bc86604f38b5f0f3a46525189a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/9c5fb5bc86604f38b5f0f3a46525189a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_9c5fb5bc86604f38b5f0f3a46525189a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9c5fb5bc86604f38b5f0f3a46525189a"}]}] Jul 05 21:01:21.028611 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2043655930 Jul 05 21:01:21.028611 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Tenant-Id: 9c5fb5bc86604f38b5f0f3a46525189a Jul 05 21:01:21.028611 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2043655930 Jul 05 21:01:21.028611 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-User: tempest-AttachVolumeShelveTestJSON-2043655930-project Jul 05 21:01:21.028611 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-User-Domain-Id: default Jul 05 21:01:21.028611 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-User-Domain-Name: Default Jul 05 21:01:21.028611 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-User-Id: a3792881ae73408db651dd6eb09b3d25 Jul 05 21:01:21.028611 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2043655930-project Jul 05 21:01:21.028611 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: method: > Jul 05 21:01:21.028611 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: exception: Instance 52848078-62a1-484f-813c-7b3352cb3851 could not be found. Jul 05 21:01:21.028611 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: action_args: {'id': '52848078-62a1-484f-813c-7b3352cb3851'} Jul 05 21:01:21.029496 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 05 21:01:21.029496 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 21:01:21.029496 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 05 21:01:21.029496 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 05 21:01:21.029496 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 05 21:01:21.029496 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 05 21:01:21.029496 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 05 21:01:21.029496 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 05 21:01:21.029496 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 05 21:01:21.029496 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 05 21:01:21.029496 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 52848078-62a1-484f-813c-7b3352cb3851 could not be found. Jul 05 21:01:21.029496 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi Jul 05 21:01:21.029496 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 21:01:21.029496 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi Jul 05 21:01:21.029496 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 21:01:21.029496 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 21:01:21.029496 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 21:01:21.029496 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 05 21:01:21.029496 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 05 21:01:21.029496 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 05 21:01:21.030899 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 05 21:01:21.030899 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 05 21:01:21.030899 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 05 21:01:21.030899 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 05 21:01:21.030899 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 05 21:01:21.030899 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 05 21:01:21.030899 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 05 21:01:21.030899 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 52848078-62a1-484f-813c-7b3352cb3851 could not be found. Jul 05 21:01:21.030899 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi Jul 05 21:01:21.030899 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 21:01:21.030899 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi Jul 05 21:01:21.030899 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 21:01:21.030899 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 21:01:21.030899 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 21:01:21.030899 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 05 21:01:21.030899 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 05 21:01:21.030899 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 52848078-62a1-484f-813c-7b3352cb3851 could not be found. Jul 05 21:01:21.030899 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi Jul 05 21:01:21.033528 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-2292a024-d994-46da-8f31-969276b7873d tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] Returning 404 to user: Instance 52848078-62a1-484f-813c-7b3352cb3851 could not be found. {{(pid=117628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 05 21:01:21.034799 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-2292a024-d994-46da-8f31-969276b7873d tempest-AttachVolumeShelveTestJSON-2043655930 tempest-AttachVolumeShelveTestJSON-2043655930-project] 10.222.0.20 "GET /compute/v2.1/servers/52848078-62a1-484f-813c-7b3352cb3851" status: 404 len: 111 microversion: 2.20 time: 0.042404 Jul 05 21:01:21.040072 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 399/779] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 5 21:01:20 2022] GET /compute/v2.1/servers/52848078-62a1-484f-813c-7b3352cb3851 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 05 21:01:24.523568 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 05 21:01:24.524117 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: Tue Jul 5 21:01:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 05 21:01:31.443132 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG dbcounter [-] [117627] Writing DB stats nova_api:SELECT=38,nova_api:UPDATE=1 {{(pid=117627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:01:31.443976 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG dbcounter [-] [117627] Writing DB stats nova_cell1:SELECT=45,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:01:31.591237 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-4590ea2d-0a19-4bae-987f-2d2ea8da69e4 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Action: 'create', calling method: .version_select at 0x7f57cdf3bdc0>, body: {"keypair": {"name": "tempest-keypair-479632561", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMraHqwlKRKXrGeqb9pOb9C2JsQT29Y/6FYuXTKci3i7fo7ycb9HMqQ110sRh85oOpWIiye+ncsbLsd6OBjvMqKXna5kuLNrnNIB0aCbmNDPxBnPsNBRnOeEVDFSFEoOUQ=="}} {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 21:01:31.607421 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.quota [None req-4590ea2d-0a19-4bae-987f-2d2ea8da69e4 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Getting quotas for project e74557ea7f0f4057b190c0adaaa80ed9. Resources: {'key_pairs'} {{(pid=117627) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 05 21:01:31.612102 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.quota [None req-4590ea2d-0a19-4bae-987f-2d2ea8da69e4 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Getting quotas for user 0e12538a6dd44bdd963e9850c24c04bc and project e74557ea7f0f4057b190c0adaaa80ed9. Resources: {'key_pairs'} {{(pid=117627) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 05 21:01:31.639418 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-4590ea2d-0a19-4bae-987f-2d2ea8da69e4 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.201509 Jul 05 21:01:31.640437 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 381/780] 10.222.0.20 () {60 vars in 1158 bytes} [Tue Jul 5 21:01:31 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 21:01:33.000875 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-12b8ebf1-cb3b-4bec-ae1a-7004f84d7f87 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1192836093", "imageRef": "88e08f49-c01d-4849-a89f-b678588e56f4", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "97c418a5-f615-4ab3-8ff8-ab5b10a93501"}], "security_groups": [{"name": "tempest-securitygroup--1940937809"}], "key_name": "tempest-keypair-479632561", "user_data": "}} {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 21:01:33.008357 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG dbcounter [-] [117628] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=2,nova_api:DELETE=2 {{(pid=117628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:01:33.009206 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG dbcounter [-] [117628] Writing DB stats nova_cell1:SELECT=68,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:01:33.113900 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.network.neutron [None req-12b8ebf1-cb3b-4bec-ae1a-7004f84d7f87 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] validate_networks() for [('97c418a5-f615-4ab3-8ff8-ab5b10a93501', None, None, None, None, None)] {{(pid=117628) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 05 21:01:33.488665 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.virt.hardware [None req-12b8ebf1-cb3b-4bec-ae1a-7004f84d7f87 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Flavor limits 0:0:0 {{(pid=117628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 05 21:01:33.489110 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.virt.hardware [None req-12b8ebf1-cb3b-4bec-ae1a-7004f84d7f87 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Image limits 0:0:0 {{(pid=117628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 05 21:01:33.489576 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.virt.hardware [None req-12b8ebf1-cb3b-4bec-ae1a-7004f84d7f87 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Flavor pref 0:0:0 {{(pid=117628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 05 21:01:33.489975 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.virt.hardware [None req-12b8ebf1-cb3b-4bec-ae1a-7004f84d7f87 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Image pref 0:0:0 {{(pid=117628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 05 21:01:33.490374 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.virt.hardware [None req-12b8ebf1-cb3b-4bec-ae1a-7004f84d7f87 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 05 21:01:33.499648 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-12b8ebf1-cb3b-4bec-ae1a-7004f84d7f87 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:01:33.500094 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-12b8ebf1-cb3b-4bec-ae1a-7004f84d7f87 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:01:33.500989 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-12b8ebf1-cb3b-4bec-ae1a-7004f84d7f87 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:01:33.501491 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-12b8ebf1-cb3b-4bec-ae1a-7004f84d7f87 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:01:33.519096 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.quota [None req-12b8ebf1-cb3b-4bec-ae1a-7004f84d7f87 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Getting quotas for project e74557ea7f0f4057b190c0adaaa80ed9. Resources: {'cores', 'ram', 'instances'} {{(pid=117628) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 05 21:01:33.523558 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.quota [None req-12b8ebf1-cb3b-4bec-ae1a-7004f84d7f87 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Getting quotas for user 0e12538a6dd44bdd963e9850c24c04bc and project e74557ea7f0f4057b190c0adaaa80ed9. Resources: {'cores', 'ram', 'instances'} {{(pid=117628) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 05 21:01:33.536139 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-12b8ebf1-cb3b-4bec-ae1a-7004f84d7f87 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Going to run 1 instances... {{(pid=117628) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 05 21:01:33.538445 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-12b8ebf1-cb3b-4bec-ae1a-7004f84d7f87 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] [instance: 90cfd865-c450-453f-b03d-8c7e897ef805] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='88e08f49-c01d-4849-a89f-b678588e56f4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117628) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 05 21:01:33.587681 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-12b8ebf1-cb3b-4bec-ae1a-7004f84d7f87 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.591210 Jul 05 21:01:33.588433 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 400/781] 10.222.0.20 () {60 vars in 1146 bytes} [Tue Jul 5 21:01:32 2022] POST /compute/v2.1/servers => generated 402 bytes in 593 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 05 21:01:33.599234 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-aebde765-83aa-4287-89aa-cfaaad2e1f44 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 21:01:33.599839 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-aebde765-83aa-4287-89aa-cfaaad2e1f44 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] [instance: 90cfd865-c450-453f-b03d-8c7e897ef805] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 21:01:33.943886 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-aebde765-83aa-4287-89aa-cfaaad2e1f44 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e12538a6dd44bdd963e9850c24c04bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e74557ea7f0f4057b190c0adaaa80ed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 21:01:33.954831 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-aebde765-83aa-4287-89aa-cfaaad2e1f44 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] 10.222.0.20 "GET /compute/v2.1/servers/90cfd865-c450-453f-b03d-8c7e897ef805" status: 200 len: 1241 microversion: 2.1 time: 0.357815 Jul 05 21:01:33.956317 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 382/782] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 21:01:33 2022] GET /compute/v2.1/servers/90cfd865-c450-453f-b03d-8c7e897ef805 => generated 1241 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 21:01:34.972490 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-b410bba4-96da-47d1-8482-5aef471c06e5 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 21:01:34.973883 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-b410bba4-96da-47d1-8482-5aef471c06e5 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] [instance: 90cfd865-c450-453f-b03d-8c7e897ef805] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 21:01:34.984177 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-b410bba4-96da-47d1-8482-5aef471c06e5 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:01:34.984741 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-b410bba4-96da-47d1-8482-5aef471c06e5 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:01:34.986807 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-b410bba4-96da-47d1-8482-5aef471c06e5 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:01:34.987888 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-b410bba4-96da-47d1-8482-5aef471c06e5 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:01:35.058906 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-b410bba4-96da-47d1-8482-5aef471c06e5 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e12538a6dd44bdd963e9850c24c04bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e74557ea7f0f4057b190c0adaaa80ed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 21:01:35.066722 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-b410bba4-96da-47d1-8482-5aef471c06e5 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] 10.222.0.20 "GET /compute/v2.1/servers/90cfd865-c450-453f-b03d-8c7e897ef805" status: 200 len: 1293 microversion: 2.1 time: 0.098702 Jul 05 21:01:35.067614 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 401/783] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 21:01:34 2022] GET /compute/v2.1/servers/90cfd865-c450-453f-b03d-8c7e897ef805 => generated 1293 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 21:01:36.084196 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-45d50610-597f-49ce-9acf-b79e46a5448d tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 21:01:36.084805 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-45d50610-597f-49ce-9acf-b79e46a5448d tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] [instance: 90cfd865-c450-453f-b03d-8c7e897ef805] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 21:01:36.090906 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-45d50610-597f-49ce-9acf-b79e46a5448d tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:01:36.091352 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-45d50610-597f-49ce-9acf-b79e46a5448d tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:01:36.092103 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-45d50610-597f-49ce-9acf-b79e46a5448d tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:01:36.092541 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-45d50610-597f-49ce-9acf-b79e46a5448d tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:01:36.153482 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-45d50610-597f-49ce-9acf-b79e46a5448d tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e12538a6dd44bdd963e9850c24c04bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e74557ea7f0f4057b190c0adaaa80ed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 21:01:36.161283 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-45d50610-597f-49ce-9acf-b79e46a5448d tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] 10.222.0.20 "GET /compute/v2.1/servers/90cfd865-c450-453f-b03d-8c7e897ef805" status: 200 len: 1293 microversion: 2.1 time: 0.081052 Jul 05 21:01:36.161836 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 383/784] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 21:01:36 2022] GET /compute/v2.1/servers/90cfd865-c450-453f-b03d-8c7e897ef805 => generated 1293 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 21:01:37.178555 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-4cf5b248-8ffc-4cfe-8780-b08794ce1259 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 21:01:37.179163 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-4cf5b248-8ffc-4cfe-8780-b08794ce1259 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] [instance: 90cfd865-c450-453f-b03d-8c7e897ef805] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 21:01:37.185959 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-4cf5b248-8ffc-4cfe-8780-b08794ce1259 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:01:37.186404 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-4cf5b248-8ffc-4cfe-8780-b08794ce1259 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:01:37.187799 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-4cf5b248-8ffc-4cfe-8780-b08794ce1259 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:01:37.188901 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-4cf5b248-8ffc-4cfe-8780-b08794ce1259 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:01:37.307769 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-4cf5b248-8ffc-4cfe-8780-b08794ce1259 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e12538a6dd44bdd963e9850c24c04bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e74557ea7f0f4057b190c0adaaa80ed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 21:01:37.316225 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-4cf5b248-8ffc-4cfe-8780-b08794ce1259 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] 10.222.0.20 "GET /compute/v2.1/servers/90cfd865-c450-453f-b03d-8c7e897ef805" status: 200 len: 1301 microversion: 2.1 time: 0.141449 Jul 05 21:01:37.320381 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 402/785] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 21:01:37 2022] GET /compute/v2.1/servers/90cfd865-c450-453f-b03d-8c7e897ef805 => generated 1301 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 21:01:38.339677 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-25a9f561-8e30-4805-b452-c3df8a51a371 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 21:01:38.340294 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-25a9f561-8e30-4805-b452-c3df8a51a371 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] [instance: 90cfd865-c450-453f-b03d-8c7e897ef805] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 21:01:38.347723 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-25a9f561-8e30-4805-b452-c3df8a51a371 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:01:38.348217 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-25a9f561-8e30-4805-b452-c3df8a51a371 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:01:38.349032 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-25a9f561-8e30-4805-b452-c3df8a51a371 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:01:38.349494 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-25a9f561-8e30-4805-b452-c3df8a51a371 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:01:38.536828 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-25a9f561-8e30-4805-b452-c3df8a51a371 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e12538a6dd44bdd963e9850c24c04bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e74557ea7f0f4057b190c0adaaa80ed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 21:01:38.544390 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-25a9f561-8e30-4805-b452-c3df8a51a371 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] 10.222.0.20 "GET /compute/v2.1/servers/90cfd865-c450-453f-b03d-8c7e897ef805" status: 200 len: 1367 microversion: 2.1 time: 0.208792 Jul 05 21:01:38.544968 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 384/786] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 21:01:38 2022] GET /compute/v2.1/servers/90cfd865-c450-453f-b03d-8c7e897ef805 => generated 1367 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 21:01:38.814576 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [req-970d5d04-d8b4-4425-922b-c795fe4eb4e3 req-6d3e0b14-e886-48f2-8caf-ebcacbcd059c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "90cfd865-c450-453f-b03d-8c7e897ef805", "tag": "c9cc78ae-754c-404b-9ff2-fd0891277d2e"}]} {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 21:01:38.828389 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [req-970d5d04-d8b4-4425-922b-c795fe4eb4e3 req-6d3e0b14-e886-48f2-8caf-ebcacbcd059c service nova] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:01:38.828980 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [req-970d5d04-d8b4-4425-922b-c795fe4eb4e3 req-6d3e0b14-e886-48f2-8caf-ebcacbcd059c service nova] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:01:38.849976 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.compute.server_external_events [req-970d5d04-d8b4-4425-922b-c795fe4eb4e3 req-6d3e0b14-e886-48f2-8caf-ebcacbcd059c service nova] Creating event network-changed:c9cc78ae-754c-404b-9ff2-fd0891277d2e for instance 90cfd865-c450-453f-b03d-8c7e897ef805 on hv-cinder-79760 Jul 05 21:01:38.855203 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [req-970d5d04-d8b4-4425-922b-c795fe4eb4e3 req-6d3e0b14-e886-48f2-8caf-ebcacbcd059c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052710 Jul 05 21:01:38.855986 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 403/787] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 5 21:01:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 21:01:39.560881 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-ee6e832a-316f-4e30-96bb-23423d07e347 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 21:01:39.561563 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-ee6e832a-316f-4e30-96bb-23423d07e347 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] [instance: 90cfd865-c450-453f-b03d-8c7e897ef805] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 21:01:39.569443 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-ee6e832a-316f-4e30-96bb-23423d07e347 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:01:39.569890 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-ee6e832a-316f-4e30-96bb-23423d07e347 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:01:39.570653 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-ee6e832a-316f-4e30-96bb-23423d07e347 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:01:39.571087 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-ee6e832a-316f-4e30-96bb-23423d07e347 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:01:39.706012 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-ee6e832a-316f-4e30-96bb-23423d07e347 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e12538a6dd44bdd963e9850c24c04bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e74557ea7f0f4057b190c0adaaa80ed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 21:01:39.713635 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-ee6e832a-316f-4e30-96bb-23423d07e347 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] 10.222.0.20 "GET /compute/v2.1/servers/90cfd865-c450-453f-b03d-8c7e897ef805" status: 200 len: 1367 microversion: 2.1 time: 0.156833 Jul 05 21:01:39.714213 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 385/788] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 21:01:39 2022] GET /compute/v2.1/servers/90cfd865-c450-453f-b03d-8c7e897ef805 => generated 1367 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 21:01:40.732048 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-6d903b34-da7e-4b61-b5da-12eba3d8ec12 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 21:01:40.732734 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-6d903b34-da7e-4b61-b5da-12eba3d8ec12 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] [instance: 90cfd865-c450-453f-b03d-8c7e897ef805] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 21:01:40.739047 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-6d903b34-da7e-4b61-b5da-12eba3d8ec12 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:01:40.739489 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-6d903b34-da7e-4b61-b5da-12eba3d8ec12 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:01:40.740324 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-6d903b34-da7e-4b61-b5da-12eba3d8ec12 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:01:40.740697 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-6d903b34-da7e-4b61-b5da-12eba3d8ec12 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:01:40.885600 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-6d903b34-da7e-4b61-b5da-12eba3d8ec12 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e12538a6dd44bdd963e9850c24c04bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e74557ea7f0f4057b190c0adaaa80ed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 21:01:40.894426 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-6d903b34-da7e-4b61-b5da-12eba3d8ec12 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] 10.222.0.20 "GET /compute/v2.1/servers/90cfd865-c450-453f-b03d-8c7e897ef805" status: 200 len: 1367 microversion: 2.1 time: 0.166868 Jul 05 21:01:40.895012 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 404/789] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 21:01:40 2022] GET /compute/v2.1/servers/90cfd865-c450-453f-b03d-8c7e897ef805 => generated 1367 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 21:01:41.911420 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-742d920e-1e7d-486a-a24b-9af0458169fc tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 21:01:41.912690 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-742d920e-1e7d-486a-a24b-9af0458169fc tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] [instance: 90cfd865-c450-453f-b03d-8c7e897ef805] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 21:01:41.919734 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-742d920e-1e7d-486a-a24b-9af0458169fc tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:01:41.920571 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-742d920e-1e7d-486a-a24b-9af0458169fc tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:01:41.921378 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-742d920e-1e7d-486a-a24b-9af0458169fc tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:01:41.921982 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-742d920e-1e7d-486a-a24b-9af0458169fc tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:01:42.076876 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-742d920e-1e7d-486a-a24b-9af0458169fc tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e12538a6dd44bdd963e9850c24c04bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e74557ea7f0f4057b190c0adaaa80ed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 21:01:42.085971 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-742d920e-1e7d-486a-a24b-9af0458169fc tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] 10.222.0.20 "GET /compute/v2.1/servers/90cfd865-c450-453f-b03d-8c7e897ef805" status: 200 len: 1367 microversion: 2.1 time: 0.179084 Jul 05 21:01:42.089353 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 386/790] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 21:01:41 2022] GET /compute/v2.1/servers/90cfd865-c450-453f-b03d-8c7e897ef805 => generated 1367 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 21:01:43.102870 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-42e93101-78d6-4adf-8c99-b705cc3cbe3e tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 21:01:43.104121 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-42e93101-78d6-4adf-8c99-b705cc3cbe3e tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] [instance: 90cfd865-c450-453f-b03d-8c7e897ef805] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 21:01:43.111392 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-42e93101-78d6-4adf-8c99-b705cc3cbe3e tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:01:43.112123 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-42e93101-78d6-4adf-8c99-b705cc3cbe3e tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:01:43.113150 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-42e93101-78d6-4adf-8c99-b705cc3cbe3e tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:01:43.113776 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-42e93101-78d6-4adf-8c99-b705cc3cbe3e tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:01:43.248421 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-42e93101-78d6-4adf-8c99-b705cc3cbe3e tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e12538a6dd44bdd963e9850c24c04bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e74557ea7f0f4057b190c0adaaa80ed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 21:01:43.256159 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-42e93101-78d6-4adf-8c99-b705cc3cbe3e tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] 10.222.0.20 "GET /compute/v2.1/servers/90cfd865-c450-453f-b03d-8c7e897ef805" status: 200 len: 1367 microversion: 2.1 time: 0.157038 Jul 05 21:01:43.256723 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 405/791] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 21:01:43 2022] GET /compute/v2.1/servers/90cfd865-c450-453f-b03d-8c7e897ef805 => generated 1367 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 21:01:44.071101 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [req-697fef27-6410-4b0a-8bce-0e15b9c984ae req-defbfd8c-920d-4a51-b754-0decc5b41995 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "90cfd865-c450-453f-b03d-8c7e897ef805", "name": "network-vif-plugged", "status": "completed", "tag": "c9cc78ae-754c-404b-9ff2-fd0891277d2e"}]} {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 21:01:44.076692 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG dbcounter [-] [117627] Writing DB stats nova_cell0:SELECT=6 {{(pid=117627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:01:44.081806 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [req-697fef27-6410-4b0a-8bce-0e15b9c984ae req-defbfd8c-920d-4a51-b754-0decc5b41995 service nova] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:01:44.082627 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [req-697fef27-6410-4b0a-8bce-0e15b9c984ae req-defbfd8c-920d-4a51-b754-0decc5b41995 service nova] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:01:44.096479 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.compute.server_external_events [req-697fef27-6410-4b0a-8bce-0e15b9c984ae req-defbfd8c-920d-4a51-b754-0decc5b41995 service nova] Creating event network-vif-plugged:c9cc78ae-754c-404b-9ff2-fd0891277d2e for instance 90cfd865-c450-453f-b03d-8c7e897ef805 on hv-cinder-79760 Jul 05 21:01:44.101761 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [req-697fef27-6410-4b0a-8bce-0e15b9c984ae req-defbfd8c-920d-4a51-b754-0decc5b41995 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034184 Jul 05 21:01:44.102550 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 387/792] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 5 21:01:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 21:01:44.273522 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-3174ba5a-a3c7-48cb-a3db-ec7cac57e985 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 21:01:44.274141 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-3174ba5a-a3c7-48cb-a3db-ec7cac57e985 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] [instance: 90cfd865-c450-453f-b03d-8c7e897ef805] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 21:01:44.276177 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG dbcounter [-] [117628] Writing DB stats nova_cell0:SELECT=2 {{(pid=117628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:01:44.276830 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG dbcounter [-] [117628] Writing DB stats nova_cell0:SELECT=6 {{(pid=117628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:01:44.284337 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-3174ba5a-a3c7-48cb-a3db-ec7cac57e985 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:01:44.284785 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-3174ba5a-a3c7-48cb-a3db-ec7cac57e985 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:01:44.285583 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-3174ba5a-a3c7-48cb-a3db-ec7cac57e985 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:01:44.286018 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-3174ba5a-a3c7-48cb-a3db-ec7cac57e985 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:01:44.468172 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-3174ba5a-a3c7-48cb-a3db-ec7cac57e985 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e12538a6dd44bdd963e9850c24c04bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e74557ea7f0f4057b190c0adaaa80ed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 21:01:44.479346 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-3174ba5a-a3c7-48cb-a3db-ec7cac57e985 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] 10.222.0.20 "GET /compute/v2.1/servers/90cfd865-c450-453f-b03d-8c7e897ef805" status: 200 len: 1367 microversion: 2.1 time: 0.209547 Jul 05 21:01:44.480038 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 406/793] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 21:01:44 2022] GET /compute/v2.1/servers/90cfd865-c450-453f-b03d-8c7e897ef805 => generated 1367 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 21:01:45.497596 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-59425d5e-5d02-402f-bc6c-724c9d84e8ce tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 21:01:45.498290 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-59425d5e-5d02-402f-bc6c-724c9d84e8ce tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] [instance: 90cfd865-c450-453f-b03d-8c7e897ef805] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 21:01:45.504583 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-59425d5e-5d02-402f-bc6c-724c9d84e8ce tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:01:45.505066 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-59425d5e-5d02-402f-bc6c-724c9d84e8ce tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:01:45.505827 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-59425d5e-5d02-402f-bc6c-724c9d84e8ce tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:01:45.506262 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-59425d5e-5d02-402f-bc6c-724c9d84e8ce tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:01:45.650654 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-59425d5e-5d02-402f-bc6c-724c9d84e8ce tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e12538a6dd44bdd963e9850c24c04bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e74557ea7f0f4057b190c0adaaa80ed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 21:01:45.658170 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-59425d5e-5d02-402f-bc6c-724c9d84e8ce tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] 10.222.0.20 "GET /compute/v2.1/servers/90cfd865-c450-453f-b03d-8c7e897ef805" status: 200 len: 1367 microversion: 2.1 time: 0.165210 Jul 05 21:01:45.658722 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 388/794] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 21:01:45 2022] GET /compute/v2.1/servers/90cfd865-c450-453f-b03d-8c7e897ef805 => generated 1367 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 21:01:46.675622 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-efd17961-8860-4012-9028-5c9f7a59bfb4 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 21:01:46.676432 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-efd17961-8860-4012-9028-5c9f7a59bfb4 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] [instance: 90cfd865-c450-453f-b03d-8c7e897ef805] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 21:01:46.683802 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-efd17961-8860-4012-9028-5c9f7a59bfb4 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:01:46.684253 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-efd17961-8860-4012-9028-5c9f7a59bfb4 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:01:46.685279 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-efd17961-8860-4012-9028-5c9f7a59bfb4 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:01:46.685771 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-efd17961-8860-4012-9028-5c9f7a59bfb4 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:01:46.825224 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-efd17961-8860-4012-9028-5c9f7a59bfb4 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e12538a6dd44bdd963e9850c24c04bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e74557ea7f0f4057b190c0adaaa80ed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 21:01:46.833540 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-efd17961-8860-4012-9028-5c9f7a59bfb4 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] 10.222.0.20 "GET /compute/v2.1/servers/90cfd865-c450-453f-b03d-8c7e897ef805" status: 200 len: 1558 microversion: 2.1 time: 0.162424 Jul 05 21:01:46.834111 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 407/795] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 21:01:46 2022] GET /compute/v2.1/servers/90cfd865-c450-453f-b03d-8c7e897ef805 => generated 1558 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 21:01:46.850866 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-78712ecf-e4b6-4e07-81f6-44b02bcb8e39 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 21:01:46.851985 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-78712ecf-e4b6-4e07-81f6-44b02bcb8e39 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] [instance: 90cfd865-c450-453f-b03d-8c7e897ef805] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 21:01:46.858480 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-78712ecf-e4b6-4e07-81f6-44b02bcb8e39 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:01:46.858921 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-78712ecf-e4b6-4e07-81f6-44b02bcb8e39 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:01:46.859747 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-78712ecf-e4b6-4e07-81f6-44b02bcb8e39 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:01:46.860132 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-78712ecf-e4b6-4e07-81f6-44b02bcb8e39 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:01:46.939251 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-78712ecf-e4b6-4e07-81f6-44b02bcb8e39 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] 10.222.0.20 "GET /compute/v2.1/servers/90cfd865-c450-453f-b03d-8c7e897ef805/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.092127 Jul 05 21:01:46.939849 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 389/796] 10.222.0.20 () {58 vars in 1274 bytes} [Tue Jul 5 21:01:46 2022] GET /compute/v2.1/servers/90cfd865-c450-453f-b03d-8c7e897ef805/os-interface => generated 285 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 05 21:01:48.107547 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [req-8bbdfe4c-99ea-4d3b-ba21-8096edba7199 req-632f4da1-de50-4e18-8902-6560065f9bdc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "90cfd865-c450-453f-b03d-8c7e897ef805", "tag": "c9cc78ae-754c-404b-9ff2-fd0891277d2e"}]} {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 21:01:48.116659 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [req-8bbdfe4c-99ea-4d3b-ba21-8096edba7199 req-632f4da1-de50-4e18-8902-6560065f9bdc service nova] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:01:48.117224 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [req-8bbdfe4c-99ea-4d3b-ba21-8096edba7199 req-632f4da1-de50-4e18-8902-6560065f9bdc service nova] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:01:48.128141 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.compute.server_external_events [req-8bbdfe4c-99ea-4d3b-ba21-8096edba7199 req-632f4da1-de50-4e18-8902-6560065f9bdc service nova] Creating event network-changed:c9cc78ae-754c-404b-9ff2-fd0891277d2e for instance 90cfd865-c450-453f-b03d-8c7e897ef805 on hv-cinder-79760 Jul 05 21:01:48.133931 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [req-8bbdfe4c-99ea-4d3b-ba21-8096edba7199 req-632f4da1-de50-4e18-8902-6560065f9bdc service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029976 Jul 05 21:01:48.134605 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 408/797] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 5 21:01:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 21:02:24.270904 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG dbcounter [-] [117627] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=1 {{(pid=117627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:02:24.271659 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG dbcounter [-] [117627] Writing DB stats nova_cell1:SELECT=36 {{(pid=117627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:02:24.276052 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-1e5293d9-11fa-4fdf-b3b7-3566591c93c6 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 21:02:24.276540 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-1e5293d9-11fa-4fdf-b3b7-3566591c93c6 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] [instance: 90cfd865-c450-453f-b03d-8c7e897ef805] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 21:02:24.283947 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-1e5293d9-11fa-4fdf-b3b7-3566591c93c6 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:02:24.284394 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-1e5293d9-11fa-4fdf-b3b7-3566591c93c6 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:02:24.285176 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-1e5293d9-11fa-4fdf-b3b7-3566591c93c6 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:02:24.285653 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-1e5293d9-11fa-4fdf-b3b7-3566591c93c6 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:02:24.309133 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-1e5293d9-11fa-4fdf-b3b7-3566591c93c6 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] 10.222.0.20 "GET /compute/v2.1/servers/90cfd865-c450-453f-b03d-8c7e897ef805/ips" status: 200 len: 150 microversion: 2.1 time: 0.039711 Jul 05 21:02:24.309701 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 390/798] 10.222.0.20 () {58 vars in 1247 bytes} [Tue Jul 5 21:02:24 2022] GET /compute/v2.1/servers/90cfd865-c450-453f-b03d-8c7e897ef805/ips => generated 150 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 21:02:25.656331 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-abf2d765-65a2-4096-8d88-aa822cd59221 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9a807808-4117-4dc3-93eb-f1d09411ebd4"}} {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 21:02:25.657561 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-abf2d765-65a2-4096-8d88-aa822cd59221 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] [instance: 90cfd865-c450-453f-b03d-8c7e897ef805] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 21:02:25.659890 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG dbcounter [-] [117628] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=3 {{(pid=117628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:02:25.660519 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG dbcounter [-] [117628] Writing DB stats nova_cell1:SELECT=42 {{(pid=117628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:02:25.666480 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-abf2d765-65a2-4096-8d88-aa822cd59221 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:02:25.666921 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-abf2d765-65a2-4096-8d88-aa822cd59221 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:02:25.667994 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-abf2d765-65a2-4096-8d88-aa822cd59221 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:02:25.668429 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-abf2d765-65a2-4096-8d88-aa822cd59221 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:02:25.926954 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-abf2d765-65a2-4096-8d88-aa822cd59221 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] 10.222.0.20 "POST /compute/v2.1/servers/90cfd865-c450-453f-b03d-8c7e897ef805/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.275935 Jul 05 21:02:25.927548 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 409/799] 10.222.0.20 () {60 vars in 1322 bytes} [Tue Jul 5 21:02:25 2022] POST /compute/v2.1/servers/90cfd865-c450-453f-b03d-8c7e897ef805/os-volume_attachments => generated 194 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 21:02:33.417863 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-60250743-8885-432b-bdec-49d7f3b3b449 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Action: 'create', calling method: .version_select at 0x7f57cded5ca0>, body: {"keypair": {"name": "tempest-keypair-436572042", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE1ga0B3kzKyXVBVuz7q7W/8At0hYT1pVtbA5gWHhzPSQfGwBdBK8l942gSj6CIvEu7JKbEYbtY0jI0iXqHUPFmGfd5hnA8TCqF0+hvAg7s3jct1KSUd/bCb4xLMk7SVXg=="}} {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 21:02:33.432336 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.quota [None req-60250743-8885-432b-bdec-49d7f3b3b449 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Getting quotas for project e74557ea7f0f4057b190c0adaaa80ed9. Resources: {'key_pairs'} {{(pid=117627) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 05 21:02:33.436147 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.quota [None req-60250743-8885-432b-bdec-49d7f3b3b449 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Getting quotas for user 0e12538a6dd44bdd963e9850c24c04bc and project e74557ea7f0f4057b190c0adaaa80ed9. Resources: {'key_pairs'} {{(pid=117627) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 05 21:02:33.457824 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-60250743-8885-432b-bdec-49d7f3b3b449 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.043773 Jul 05 21:02:33.458397 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 391/800] 10.222.0.20 () {60 vars in 1158 bytes} [Tue Jul 5 21:02:33 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 21:02:34.248341 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-5fb4429b-0d76-42f0-bf96-e4014f22eb49 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-129445796", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-858447728", "security_groups": [{"name": "tempest-secgroup-smoke-1135024658"}], "block_device_mapping_v2": [{"uuid": "f067ca2e-4189-40ad-8ea0-9df8da1f52ee", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "cd331159-a19a-44ee-94a4-edd89916e91b"}]}} {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 21:02:34.393380 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.network.neutron [None req-5fb4429b-0d76-42f0-bf96-e4014f22eb49 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] validate_networks() for [('cd331159-a19a-44ee-94a4-edd89916e91b', None, None, None, None, None)] {{(pid=117628) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 05 21:02:35.233258 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.virt.hardware [None req-5fb4429b-0d76-42f0-bf96-e4014f22eb49 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Flavor limits 0:0:0 {{(pid=117628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 05 21:02:35.233781 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.virt.hardware [None req-5fb4429b-0d76-42f0-bf96-e4014f22eb49 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Image limits 0:0:0 {{(pid=117628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 05 21:02:35.234270 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.virt.hardware [None req-5fb4429b-0d76-42f0-bf96-e4014f22eb49 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Flavor pref 0:0:0 {{(pid=117628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 05 21:02:35.234678 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.virt.hardware [None req-5fb4429b-0d76-42f0-bf96-e4014f22eb49 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Image pref 0:0:0 {{(pid=117628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 05 21:02:35.235091 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.virt.hardware [None req-5fb4429b-0d76-42f0-bf96-e4014f22eb49 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 05 21:02:35.235956 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG dbcounter [-] [117627] Writing DB stats nova_cell1:SELECT=4 {{(pid=117627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:02:35.240897 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-b1251a2b-42cf-461f-86fb-2d44ce6875c7 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1389978231", "imageRef": "88e08f49-c01d-4849-a89f-b678588e56f4", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "97c418a5-f615-4ab3-8ff8-ab5b10a93501"}], "security_groups": [{"name": "tempest-securitygroup--334693522"}], "key_name": "tempest-keypair-436572042", "user_data": "}} {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 21:02:35.244093 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-5fb4429b-0d76-42f0-bf96-e4014f22eb49 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:02:35.244548 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-5fb4429b-0d76-42f0-bf96-e4014f22eb49 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:02:35.245393 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-5fb4429b-0d76-42f0-bf96-e4014f22eb49 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:02:35.245831 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-5fb4429b-0d76-42f0-bf96-e4014f22eb49 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:02:35.262871 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.quota [None req-5fb4429b-0d76-42f0-bf96-e4014f22eb49 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Getting quotas for project 6c9a3d56f8b84eb2a057425afbf79079. Resources: {'cores', 'ram', 'instances'} {{(pid=117628) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 05 21:02:35.267179 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.quota [None req-5fb4429b-0d76-42f0-bf96-e4014f22eb49 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Getting quotas for user 261feb03a8ff459b8874232bec05034f and project 6c9a3d56f8b84eb2a057425afbf79079. Resources: {'cores', 'ram', 'instances'} {{(pid=117628) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 05 21:02:35.326343 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-5fb4429b-0d76-42f0-bf96-e4014f22eb49 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Going to run 1 instances... {{(pid=117628) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 05 21:02:35.328498 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-5fb4429b-0d76-42f0-bf96-e4014f22eb49 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] [instance: 31d561da-981c-4461-ac77-28d08ec752ad] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='f067ca2e-4189-40ad-8ea0-9df8da1f52ee',volume_size=None,volume_type=None)] {{(pid=117628) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 05 21:02:35.347235 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.network.neutron [None req-b1251a2b-42cf-461f-86fb-2d44ce6875c7 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] validate_networks() for [('97c418a5-f615-4ab3-8ff8-ab5b10a93501', None, None, None, None, None)] {{(pid=117627) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 05 21:02:35.458246 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-5fb4429b-0d76-42f0-bf96-e4014f22eb49 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.214733 Jul 05 21:02:35.458900 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 410/801] 10.222.0.20 () {60 vars in 1146 bytes} [Tue Jul 5 21:02:34 2022] POST /compute/v2.1/servers => generated 406 bytes in 1216 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 05 21:02:35.469506 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-8a1337f8-b066-4f0a-a812-7619978d1a6c tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 21:02:35.470108 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-8a1337f8-b066-4f0a-a812-7619978d1a6c tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] [instance: 31d561da-981c-4461-ac77-28d08ec752ad] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 21:02:35.551278 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-8a1337f8-b066-4f0a-a812-7619978d1a6c tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '261feb03a8ff459b8874232bec05034f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9a3d56f8b84eb2a057425afbf79079', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 21:02:35.558195 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-8a1337f8-b066-4f0a-a812-7619978d1a6c tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] 10.222.0.20 "GET /compute/v2.1/servers/31d561da-981c-4461-ac77-28d08ec752ad" status: 200 len: 1093 microversion: 2.1 time: 0.093047 Jul 05 21:02:35.558916 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 411/802] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 21:02:35 2022] GET /compute/v2.1/servers/31d561da-981c-4461-ac77-28d08ec752ad => generated 1093 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 21:02:35.784061 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.virt.hardware [None req-b1251a2b-42cf-461f-86fb-2d44ce6875c7 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Flavor limits 0:0:0 {{(pid=117627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 05 21:02:35.784061 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.virt.hardware [None req-b1251a2b-42cf-461f-86fb-2d44ce6875c7 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Image limits 0:0:0 {{(pid=117627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 05 21:02:35.784061 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.virt.hardware [None req-b1251a2b-42cf-461f-86fb-2d44ce6875c7 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Flavor pref 0:0:0 {{(pid=117627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 05 21:02:35.784061 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.virt.hardware [None req-b1251a2b-42cf-461f-86fb-2d44ce6875c7 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Image pref 0:0:0 {{(pid=117627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 05 21:02:35.784061 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.virt.hardware [None req-b1251a2b-42cf-461f-86fb-2d44ce6875c7 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 05 21:02:35.786292 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-b1251a2b-42cf-461f-86fb-2d44ce6875c7 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:02:35.786292 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-b1251a2b-42cf-461f-86fb-2d44ce6875c7 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:02:35.787122 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-b1251a2b-42cf-461f-86fb-2d44ce6875c7 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:02:35.787745 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-b1251a2b-42cf-461f-86fb-2d44ce6875c7 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:02:35.805922 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.quota [None req-b1251a2b-42cf-461f-86fb-2d44ce6875c7 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Getting quotas for project e74557ea7f0f4057b190c0adaaa80ed9. Resources: {'cores', 'ram', 'instances'} {{(pid=117627) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 05 21:02:35.810703 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.quota [None req-b1251a2b-42cf-461f-86fb-2d44ce6875c7 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Getting quotas for user 0e12538a6dd44bdd963e9850c24c04bc and project e74557ea7f0f4057b190c0adaaa80ed9. Resources: {'cores', 'ram', 'instances'} {{(pid=117627) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 05 21:02:35.823049 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-b1251a2b-42cf-461f-86fb-2d44ce6875c7 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Going to run 1 instances... {{(pid=117627) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 05 21:02:35.825473 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-b1251a2b-42cf-461f-86fb-2d44ce6875c7 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] [instance: db7345ee-2fba-477b-8841-dc561c29e754] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='88e08f49-c01d-4849-a89f-b678588e56f4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117627) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 05 21:02:35.870614 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR oslo.messaging._drivers.impl_rabbit [None req-b1251a2b-42cf-461f-86fb-2d44ce6875c7 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] [0fe66dcc-0e63-44b5-b535-6eb3e4a70365] AMQP server on 10.222.0.20:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 05 21:02:36.575094 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-22981289-dfc1-4423-b7d1-c9ae84a4807f tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 21:02:36.576441 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-22981289-dfc1-4423-b7d1-c9ae84a4807f tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] [instance: 31d561da-981c-4461-ac77-28d08ec752ad] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 21:02:36.583356 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-22981289-dfc1-4423-b7d1-c9ae84a4807f tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:02:36.583807 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-22981289-dfc1-4423-b7d1-c9ae84a4807f tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:02:36.584572 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-22981289-dfc1-4423-b7d1-c9ae84a4807f tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:02:36.585160 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-22981289-dfc1-4423-b7d1-c9ae84a4807f tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:02:36.647885 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-22981289-dfc1-4423-b7d1-c9ae84a4807f tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '261feb03a8ff459b8874232bec05034f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9a3d56f8b84eb2a057425afbf79079', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 21:02:36.655702 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-22981289-dfc1-4423-b7d1-c9ae84a4807f tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] 10.222.0.20 "GET /compute/v2.1/servers/31d561da-981c-4461-ac77-28d08ec752ad" status: 200 len: 1191 microversion: 2.1 time: 0.084380 Jul 05 21:02:36.656274 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 412/803] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 21:02:36 2022] GET /compute/v2.1/servers/31d561da-981c-4461-ac77-28d08ec752ad => generated 1191 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 21:02:36.882654 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO oslo.messaging._drivers.impl_rabbit [None req-b1251a2b-42cf-461f-86fb-2d44ce6875c7 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] [0fe66dcc-0e63-44b5-b535-6eb3e4a70365] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 42038. Jul 05 21:02:36.889683 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-b1251a2b-42cf-461f-86fb-2d44ce6875c7 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.654326 Jul 05 21:02:36.898298 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 392/804] 10.222.0.20 () {60 vars in 1146 bytes} [Tue Jul 5 21:02:35 2022] POST /compute/v2.1/servers => generated 401 bytes in 1662 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 05 21:02:36.900321 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-30840b18-9d65-4075-bf54-d6ffd4dac9e1 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 21:02:36.901143 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-30840b18-9d65-4075-bf54-d6ffd4dac9e1 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] [instance: db7345ee-2fba-477b-8841-dc561c29e754] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 21:02:36.987714 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-30840b18-9d65-4075-bf54-d6ffd4dac9e1 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e12538a6dd44bdd963e9850c24c04bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e74557ea7f0f4057b190c0adaaa80ed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 21:02:36.994993 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-30840b18-9d65-4075-bf54-d6ffd4dac9e1 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] 10.222.0.20 "GET /compute/v2.1/servers/db7345ee-2fba-477b-8841-dc561c29e754" status: 200 len: 1241 microversion: 2.1 time: 0.098392 Jul 05 21:02:36.995560 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 413/805] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 21:02:36 2022] GET /compute/v2.1/servers/db7345ee-2fba-477b-8841-dc561c29e754 => generated 1241 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 21:02:37.674904 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-2d404cc9-3e8a-4792-bb22-77dd4874681c tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 21:02:37.675744 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-2d404cc9-3e8a-4792-bb22-77dd4874681c tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] [instance: 31d561da-981c-4461-ac77-28d08ec752ad] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 21:02:37.681968 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-2d404cc9-3e8a-4792-bb22-77dd4874681c tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:02:37.682409 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-2d404cc9-3e8a-4792-bb22-77dd4874681c tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:02:37.683156 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-2d404cc9-3e8a-4792-bb22-77dd4874681c tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:02:37.683583 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-2d404cc9-3e8a-4792-bb22-77dd4874681c tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:02:37.940409 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-2d404cc9-3e8a-4792-bb22-77dd4874681c tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '261feb03a8ff459b8874232bec05034f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9a3d56f8b84eb2a057425afbf79079', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 21:02:37.948083 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-2d404cc9-3e8a-4792-bb22-77dd4874681c tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] 10.222.0.20 "GET /compute/v2.1/servers/31d561da-981c-4461-ac77-28d08ec752ad" status: 200 len: 1265 microversion: 2.1 time: 0.277873 Jul 05 21:02:37.948849 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 393/806] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 21:02:37 2022] GET /compute/v2.1/servers/31d561da-981c-4461-ac77-28d08ec752ad => generated 1265 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 21:02:38.011717 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-3b45aa7e-29d5-48c2-a456-100676c1d746 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 21:02:38.012325 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-3b45aa7e-29d5-48c2-a456-100676c1d746 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] [instance: db7345ee-2fba-477b-8841-dc561c29e754] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 21:02:38.019774 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-3b45aa7e-29d5-48c2-a456-100676c1d746 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:02:38.020568 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-3b45aa7e-29d5-48c2-a456-100676c1d746 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:02:38.021599 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-3b45aa7e-29d5-48c2-a456-100676c1d746 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:02:38.022273 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-3b45aa7e-29d5-48c2-a456-100676c1d746 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:02:38.131938 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-3b45aa7e-29d5-48c2-a456-100676c1d746 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e12538a6dd44bdd963e9850c24c04bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e74557ea7f0f4057b190c0adaaa80ed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 21:02:38.145758 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-3b45aa7e-29d5-48c2-a456-100676c1d746 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] 10.222.0.20 "GET /compute/v2.1/servers/db7345ee-2fba-477b-8841-dc561c29e754" status: 200 len: 1301 microversion: 2.1 time: 0.137857 Jul 05 21:02:38.147286 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 414/807] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 21:02:38 2022] GET /compute/v2.1/servers/db7345ee-2fba-477b-8841-dc561c29e754 => generated 1301 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 21:02:38.312342 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [req-cea7f4a1-8fea-4a37-8f4e-15b94844c72d req-7d9ce74f-e782-412a-853f-615b2b82a26f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "31d561da-981c-4461-ac77-28d08ec752ad", "tag": "c770b7ee-822c-4aa2-aba0-ca803c58e3b4"}]} {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 21:02:38.332525 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [req-cea7f4a1-8fea-4a37-8f4e-15b94844c72d req-7d9ce74f-e782-412a-853f-615b2b82a26f service nova] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:02:38.333016 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [req-cea7f4a1-8fea-4a37-8f4e-15b94844c72d req-7d9ce74f-e782-412a-853f-615b2b82a26f service nova] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:02:38.351269 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.compute.server_external_events [req-cea7f4a1-8fea-4a37-8f4e-15b94844c72d req-7d9ce74f-e782-412a-853f-615b2b82a26f service nova] Creating event network-changed:c770b7ee-822c-4aa2-aba0-ca803c58e3b4 for instance 31d561da-981c-4461-ac77-28d08ec752ad on hv-cinder-79760 Jul 05 21:02:38.357438 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [req-cea7f4a1-8fea-4a37-8f4e-15b94844c72d req-7d9ce74f-e782-412a-853f-615b2b82a26f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048671 Jul 05 21:02:38.358691 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 394/808] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 5 21:02:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 21:02:38.965364 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-eb0f96cc-d260-49d1-bd86-794406644321 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 21:02:38.966134 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-eb0f96cc-d260-49d1-bd86-794406644321 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] [instance: 31d561da-981c-4461-ac77-28d08ec752ad] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 21:02:38.972514 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-eb0f96cc-d260-49d1-bd86-794406644321 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:02:38.973105 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-eb0f96cc-d260-49d1-bd86-794406644321 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:02:38.973955 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-eb0f96cc-d260-49d1-bd86-794406644321 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:02:38.974466 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-eb0f96cc-d260-49d1-bd86-794406644321 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:02:39.165844 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-1eda4319-1b4f-495a-a008-c950f16c0f2f tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 21:02:39.166353 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-eb0f96cc-d260-49d1-bd86-794406644321 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '261feb03a8ff459b8874232bec05034f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9a3d56f8b84eb2a057425afbf79079', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 21:02:39.167783 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-1eda4319-1b4f-495a-a008-c950f16c0f2f tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] [instance: db7345ee-2fba-477b-8841-dc561c29e754] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 21:02:39.175321 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-eb0f96cc-d260-49d1-bd86-794406644321 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] 10.222.0.20 "GET /compute/v2.1/servers/31d561da-981c-4461-ac77-28d08ec752ad" status: 200 len: 1265 microversion: 2.1 time: 0.213765 Jul 05 21:02:39.176572 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-1eda4319-1b4f-495a-a008-c950f16c0f2f tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:02:39.176708 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 415/809] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 21:02:38 2022] GET /compute/v2.1/servers/31d561da-981c-4461-ac77-28d08ec752ad => generated 1265 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 21:02:39.177386 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-1eda4319-1b4f-495a-a008-c950f16c0f2f tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:02:39.178454 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-1eda4319-1b4f-495a-a008-c950f16c0f2f tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:02:39.179093 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-1eda4319-1b4f-495a-a008-c950f16c0f2f tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:02:39.426246 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-1eda4319-1b4f-495a-a008-c950f16c0f2f tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e12538a6dd44bdd963e9850c24c04bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e74557ea7f0f4057b190c0adaaa80ed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 21:02:39.434024 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-1eda4319-1b4f-495a-a008-c950f16c0f2f tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] 10.222.0.20 "GET /compute/v2.1/servers/db7345ee-2fba-477b-8841-dc561c29e754" status: 200 len: 1366 microversion: 2.1 time: 0.272897 Jul 05 21:02:39.434597 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 395/810] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 21:02:39 2022] GET /compute/v2.1/servers/db7345ee-2fba-477b-8841-dc561c29e754 => generated 1366 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 21:02:39.719292 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [req-bfcc3cbf-e788-4d86-8833-43c5582d00df req-a71872fa-03e5-4234-bc63-93e5ffef75ef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "db7345ee-2fba-477b-8841-dc561c29e754", "tag": "2af3ace7-9b55-4a90-8437-021f139a1eb4"}]} {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 21:02:39.729284 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [req-bfcc3cbf-e788-4d86-8833-43c5582d00df req-a71872fa-03e5-4234-bc63-93e5ffef75ef service nova] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:02:39.733234 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [req-bfcc3cbf-e788-4d86-8833-43c5582d00df req-a71872fa-03e5-4234-bc63-93e5ffef75ef service nova] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:02:39.745055 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.compute.server_external_events [req-bfcc3cbf-e788-4d86-8833-43c5582d00df req-a71872fa-03e5-4234-bc63-93e5ffef75ef service nova] Creating event network-changed:2af3ace7-9b55-4a90-8437-021f139a1eb4 for instance db7345ee-2fba-477b-8841-dc561c29e754 on hv-cinder-79760 Jul 05 21:02:39.751079 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [req-bfcc3cbf-e788-4d86-8833-43c5582d00df req-a71872fa-03e5-4234-bc63-93e5ffef75ef service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035315 Jul 05 21:02:39.751688 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 416/811] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 5 21:02:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 21:02:40.193067 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-a149886e-1d0d-425f-b28e-690af72db115 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 21:02:40.193663 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-a149886e-1d0d-425f-b28e-690af72db115 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] [instance: 31d561da-981c-4461-ac77-28d08ec752ad] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 21:02:40.200235 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-a149886e-1d0d-425f-b28e-690af72db115 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:02:40.200714 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-a149886e-1d0d-425f-b28e-690af72db115 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:02:40.201508 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-a149886e-1d0d-425f-b28e-690af72db115 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:02:40.201940 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-a149886e-1d0d-425f-b28e-690af72db115 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:02:40.330571 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-a149886e-1d0d-425f-b28e-690af72db115 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '261feb03a8ff459b8874232bec05034f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9a3d56f8b84eb2a057425afbf79079', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 21:02:40.337962 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-a149886e-1d0d-425f-b28e-690af72db115 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] 10.222.0.20 "GET /compute/v2.1/servers/31d561da-981c-4461-ac77-28d08ec752ad" status: 200 len: 1265 microversion: 2.1 time: 0.149056 Jul 05 21:02:40.338519 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 396/812] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 21:02:40 2022] GET /compute/v2.1/servers/31d561da-981c-4461-ac77-28d08ec752ad => generated 1265 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 21:02:40.453537 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-4ca42352-ed2b-41ac-9bf3-f1959be9b9d0 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 21:02:40.454194 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-4ca42352-ed2b-41ac-9bf3-f1959be9b9d0 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] [instance: db7345ee-2fba-477b-8841-dc561c29e754] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 21:02:40.461637 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-4ca42352-ed2b-41ac-9bf3-f1959be9b9d0 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:02:40.462277 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-4ca42352-ed2b-41ac-9bf3-f1959be9b9d0 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:02:40.463047 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-4ca42352-ed2b-41ac-9bf3-f1959be9b9d0 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:02:40.463468 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-4ca42352-ed2b-41ac-9bf3-f1959be9b9d0 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:02:40.597859 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-4ca42352-ed2b-41ac-9bf3-f1959be9b9d0 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e12538a6dd44bdd963e9850c24c04bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e74557ea7f0f4057b190c0adaaa80ed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 21:02:40.605300 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-4ca42352-ed2b-41ac-9bf3-f1959be9b9d0 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] 10.222.0.20 "GET /compute/v2.1/servers/db7345ee-2fba-477b-8841-dc561c29e754" status: 200 len: 1366 microversion: 2.1 time: 0.157010 Jul 05 21:02:40.605862 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 417/813] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 21:02:40 2022] GET /compute/v2.1/servers/db7345ee-2fba-477b-8841-dc561c29e754 => generated 1366 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 21:02:41.355584 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-2592ae73-4039-4e47-8fc8-e66728871706 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 21:02:41.356365 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-2592ae73-4039-4e47-8fc8-e66728871706 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] [instance: 31d561da-981c-4461-ac77-28d08ec752ad] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 21:02:41.364562 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-2592ae73-4039-4e47-8fc8-e66728871706 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:02:41.365527 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-2592ae73-4039-4e47-8fc8-e66728871706 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:02:41.366140 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-2592ae73-4039-4e47-8fc8-e66728871706 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:02:41.366922 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-2592ae73-4039-4e47-8fc8-e66728871706 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:02:41.498533 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-2592ae73-4039-4e47-8fc8-e66728871706 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '261feb03a8ff459b8874232bec05034f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9a3d56f8b84eb2a057425afbf79079', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 21:02:41.506036 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-2592ae73-4039-4e47-8fc8-e66728871706 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] 10.222.0.20 "GET /compute/v2.1/servers/31d561da-981c-4461-ac77-28d08ec752ad" status: 200 len: 1265 microversion: 2.1 time: 0.154379 Jul 05 21:02:41.506597 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 397/814] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 21:02:41 2022] GET /compute/v2.1/servers/31d561da-981c-4461-ac77-28d08ec752ad => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 21:02:41.621453 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-591eee3e-1734-4767-8c9e-b94cd76224f6 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 21:02:41.622008 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-591eee3e-1734-4767-8c9e-b94cd76224f6 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] [instance: db7345ee-2fba-477b-8841-dc561c29e754] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 21:02:41.628473 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-591eee3e-1734-4767-8c9e-b94cd76224f6 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:02:41.628921 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-591eee3e-1734-4767-8c9e-b94cd76224f6 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:02:41.629957 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-591eee3e-1734-4767-8c9e-b94cd76224f6 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:02:41.630387 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-591eee3e-1734-4767-8c9e-b94cd76224f6 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:02:41.761241 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-591eee3e-1734-4767-8c9e-b94cd76224f6 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e12538a6dd44bdd963e9850c24c04bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e74557ea7f0f4057b190c0adaaa80ed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 21:02:41.769702 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-591eee3e-1734-4767-8c9e-b94cd76224f6 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] 10.222.0.20 "GET /compute/v2.1/servers/db7345ee-2fba-477b-8841-dc561c29e754" status: 200 len: 1366 microversion: 2.1 time: 0.152059 Jul 05 21:02:41.770281 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 418/815] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 21:02:41 2022] GET /compute/v2.1/servers/db7345ee-2fba-477b-8841-dc561c29e754 => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 21:02:42.523421 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-7685917f-b072-4b5b-8fbb-8e33af48edbc tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 21:02:42.524031 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-7685917f-b072-4b5b-8fbb-8e33af48edbc tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] [instance: 31d561da-981c-4461-ac77-28d08ec752ad] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 21:02:42.530985 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-7685917f-b072-4b5b-8fbb-8e33af48edbc tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:02:42.531425 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-7685917f-b072-4b5b-8fbb-8e33af48edbc tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:02:42.532186 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-7685917f-b072-4b5b-8fbb-8e33af48edbc tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:02:42.532615 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-7685917f-b072-4b5b-8fbb-8e33af48edbc tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:02:42.668319 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-7685917f-b072-4b5b-8fbb-8e33af48edbc tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '261feb03a8ff459b8874232bec05034f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9a3d56f8b84eb2a057425afbf79079', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 21:02:42.676552 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-7685917f-b072-4b5b-8fbb-8e33af48edbc tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] 10.222.0.20 "GET /compute/v2.1/servers/31d561da-981c-4461-ac77-28d08ec752ad" status: 200 len: 1265 microversion: 2.1 time: 0.156893 Jul 05 21:02:42.677176 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 398/816] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 21:02:42 2022] GET /compute/v2.1/servers/31d561da-981c-4461-ac77-28d08ec752ad => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 21:02:42.786977 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-1c13b42c-c3ec-4fe7-ad38-460826cda5d4 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 21:02:42.787575 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-1c13b42c-c3ec-4fe7-ad38-460826cda5d4 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] [instance: db7345ee-2fba-477b-8841-dc561c29e754] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 21:02:42.794603 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-1c13b42c-c3ec-4fe7-ad38-460826cda5d4 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:02:42.795110 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-1c13b42c-c3ec-4fe7-ad38-460826cda5d4 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:02:42.795972 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-1c13b42c-c3ec-4fe7-ad38-460826cda5d4 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:02:42.796401 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-1c13b42c-c3ec-4fe7-ad38-460826cda5d4 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:02:42.928843 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-1c13b42c-c3ec-4fe7-ad38-460826cda5d4 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e12538a6dd44bdd963e9850c24c04bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e74557ea7f0f4057b190c0adaaa80ed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 21:02:42.936269 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-1c13b42c-c3ec-4fe7-ad38-460826cda5d4 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] 10.222.0.20 "GET /compute/v2.1/servers/db7345ee-2fba-477b-8841-dc561c29e754" status: 200 len: 1366 microversion: 2.1 time: 0.153069 Jul 05 21:02:42.936831 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 419/817] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 21:02:42 2022] GET /compute/v2.1/servers/db7345ee-2fba-477b-8841-dc561c29e754 => generated 1366 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 21:02:43.693579 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-c1526354-eae7-4027-a043-9d447557203f tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 21:02:43.694182 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-c1526354-eae7-4027-a043-9d447557203f tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] [instance: 31d561da-981c-4461-ac77-28d08ec752ad] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 21:02:43.700704 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-c1526354-eae7-4027-a043-9d447557203f tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:02:43.701170 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-c1526354-eae7-4027-a043-9d447557203f tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:02:43.701918 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-c1526354-eae7-4027-a043-9d447557203f tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:02:43.702346 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-c1526354-eae7-4027-a043-9d447557203f tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:02:43.832535 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-c1526354-eae7-4027-a043-9d447557203f tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '261feb03a8ff459b8874232bec05034f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9a3d56f8b84eb2a057425afbf79079', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 21:02:43.839883 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-c1526354-eae7-4027-a043-9d447557203f tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] 10.222.0.20 "GET /compute/v2.1/servers/31d561da-981c-4461-ac77-28d08ec752ad" status: 200 len: 1265 microversion: 2.1 time: 0.150153 Jul 05 21:02:43.840440 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 399/818] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 21:02:43 2022] GET /compute/v2.1/servers/31d561da-981c-4461-ac77-28d08ec752ad => generated 1265 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 21:02:43.953446 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-ae1b5f37-a6f3-49fc-a496-9efcb484aabf tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 21:02:43.954022 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-ae1b5f37-a6f3-49fc-a496-9efcb484aabf tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] [instance: db7345ee-2fba-477b-8841-dc561c29e754] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 21:02:43.960466 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-ae1b5f37-a6f3-49fc-a496-9efcb484aabf tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:02:43.960911 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-ae1b5f37-a6f3-49fc-a496-9efcb484aabf tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:02:43.961692 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-ae1b5f37-a6f3-49fc-a496-9efcb484aabf tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:02:43.962119 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-ae1b5f37-a6f3-49fc-a496-9efcb484aabf tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:02:44.089425 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-ae1b5f37-a6f3-49fc-a496-9efcb484aabf tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e12538a6dd44bdd963e9850c24c04bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e74557ea7f0f4057b190c0adaaa80ed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 21:02:44.097368 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-ae1b5f37-a6f3-49fc-a496-9efcb484aabf tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] 10.222.0.20 "GET /compute/v2.1/servers/db7345ee-2fba-477b-8841-dc561c29e754" status: 200 len: 1366 microversion: 2.1 time: 0.147993 Jul 05 21:02:44.098076 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 420/819] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 21:02:43 2022] GET /compute/v2.1/servers/db7345ee-2fba-477b-8841-dc561c29e754 => generated 1366 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 21:02:44.490883 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [req-19a292d2-ccb4-4e0a-84cb-4423a3ffe255 req-9297ef5f-1507-4d28-b2f9-82f9459d68d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db7345ee-2fba-477b-8841-dc561c29e754", "name": "network-vif-plugged", "status": "completed", "tag": "2af3ace7-9b55-4a90-8437-021f139a1eb4"}]} {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 21:02:44.499785 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [req-19a292d2-ccb4-4e0a-84cb-4423a3ffe255 req-9297ef5f-1507-4d28-b2f9-82f9459d68d9 service nova] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:02:44.499785 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [req-19a292d2-ccb4-4e0a-84cb-4423a3ffe255 req-9297ef5f-1507-4d28-b2f9-82f9459d68d9 service nova] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:02:44.511011 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.compute.server_external_events [req-19a292d2-ccb4-4e0a-84cb-4423a3ffe255 req-9297ef5f-1507-4d28-b2f9-82f9459d68d9 service nova] Creating event network-vif-plugged:2af3ace7-9b55-4a90-8437-021f139a1eb4 for instance db7345ee-2fba-477b-8841-dc561c29e754 on hv-cinder-79760 Jul 05 21:02:44.517183 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [req-19a292d2-ccb4-4e0a-84cb-4423a3ffe255 req-9297ef5f-1507-4d28-b2f9-82f9459d68d9 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030009 Jul 05 21:02:44.517774 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 400/820] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 5 21:02:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 21:02:44.857426 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-651e4e51-a4d9-4c2d-be9a-d6c78fba6ed9 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 21:02:44.858132 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-651e4e51-a4d9-4c2d-be9a-d6c78fba6ed9 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] [instance: 31d561da-981c-4461-ac77-28d08ec752ad] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 21:02:44.864127 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-651e4e51-a4d9-4c2d-be9a-d6c78fba6ed9 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:02:44.864571 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-651e4e51-a4d9-4c2d-be9a-d6c78fba6ed9 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:02:44.865354 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-651e4e51-a4d9-4c2d-be9a-d6c78fba6ed9 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:02:44.865783 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-651e4e51-a4d9-4c2d-be9a-d6c78fba6ed9 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:02:45.003229 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-651e4e51-a4d9-4c2d-be9a-d6c78fba6ed9 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '261feb03a8ff459b8874232bec05034f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9a3d56f8b84eb2a057425afbf79079', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 21:02:45.010672 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-651e4e51-a4d9-4c2d-be9a-d6c78fba6ed9 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] 10.222.0.20 "GET /compute/v2.1/servers/31d561da-981c-4461-ac77-28d08ec752ad" status: 200 len: 1265 microversion: 2.1 time: 0.157377 Jul 05 21:02:45.011256 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 421/821] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 21:02:44 2022] GET /compute/v2.1/servers/31d561da-981c-4461-ac77-28d08ec752ad => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 21:02:45.115626 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-ac55c8f4-c6cd-4777-840e-e274049a2ea0 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 21:02:45.116340 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-ac55c8f4-c6cd-4777-840e-e274049a2ea0 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] [instance: db7345ee-2fba-477b-8841-dc561c29e754] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 21:02:45.122573 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-ac55c8f4-c6cd-4777-840e-e274049a2ea0 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:02:45.123016 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-ac55c8f4-c6cd-4777-840e-e274049a2ea0 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:02:45.123758 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-ac55c8f4-c6cd-4777-840e-e274049a2ea0 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:02:45.124179 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-ac55c8f4-c6cd-4777-840e-e274049a2ea0 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:02:45.250806 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-ac55c8f4-c6cd-4777-840e-e274049a2ea0 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e12538a6dd44bdd963e9850c24c04bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e74557ea7f0f4057b190c0adaaa80ed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 21:02:45.258114 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-ac55c8f4-c6cd-4777-840e-e274049a2ea0 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] 10.222.0.20 "GET /compute/v2.1/servers/db7345ee-2fba-477b-8841-dc561c29e754" status: 200 len: 1366 microversion: 2.1 time: 0.147151 Jul 05 21:02:45.258671 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 401/822] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 21:02:45 2022] GET /compute/v2.1/servers/db7345ee-2fba-477b-8841-dc561c29e754 => generated 1366 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 21:02:46.027672 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-2e250891-7c14-4032-bcf8-5f51d501f6a8 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 21:02:46.028258 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-2e250891-7c14-4032-bcf8-5f51d501f6a8 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] [instance: 31d561da-981c-4461-ac77-28d08ec752ad] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 21:02:46.030270 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG dbcounter [-] [117628] Writing DB stats nova_cell0:SELECT=2 {{(pid=117628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:02:46.036039 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-2e250891-7c14-4032-bcf8-5f51d501f6a8 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:02:46.036482 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-2e250891-7c14-4032-bcf8-5f51d501f6a8 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:02:46.037264 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-2e250891-7c14-4032-bcf8-5f51d501f6a8 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:02:46.037698 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-2e250891-7c14-4032-bcf8-5f51d501f6a8 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:02:46.180981 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-2e250891-7c14-4032-bcf8-5f51d501f6a8 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '261feb03a8ff459b8874232bec05034f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9a3d56f8b84eb2a057425afbf79079', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 21:02:46.189409 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-2e250891-7c14-4032-bcf8-5f51d501f6a8 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] 10.222.0.20 "GET /compute/v2.1/servers/31d561da-981c-4461-ac77-28d08ec752ad" status: 200 len: 1265 microversion: 2.1 time: 0.165704 Jul 05 21:02:46.189969 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 422/823] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 21:02:46 2022] GET /compute/v2.1/servers/31d561da-981c-4461-ac77-28d08ec752ad => generated 1265 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 21:02:46.275363 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-d7c861af-b3f5-43a5-8295-ed8a905d6ba8 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 21:02:46.275966 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-d7c861af-b3f5-43a5-8295-ed8a905d6ba8 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] [instance: db7345ee-2fba-477b-8841-dc561c29e754] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 21:02:46.277993 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG dbcounter [-] [117627] Writing DB stats nova_cell0:SELECT=2 {{(pid=117627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:02:46.278632 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG dbcounter [-] [117627] Writing DB stats nova_cell0:SELECT=10 {{(pid=117627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:02:46.285070 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-d7c861af-b3f5-43a5-8295-ed8a905d6ba8 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:02:46.285512 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-d7c861af-b3f5-43a5-8295-ed8a905d6ba8 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:02:46.286263 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-d7c861af-b3f5-43a5-8295-ed8a905d6ba8 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:02:46.286688 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-d7c861af-b3f5-43a5-8295-ed8a905d6ba8 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:02:46.425408 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-d7c861af-b3f5-43a5-8295-ed8a905d6ba8 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e12538a6dd44bdd963e9850c24c04bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e74557ea7f0f4057b190c0adaaa80ed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 21:02:46.433592 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-d7c861af-b3f5-43a5-8295-ed8a905d6ba8 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] 10.222.0.20 "GET /compute/v2.1/servers/db7345ee-2fba-477b-8841-dc561c29e754" status: 200 len: 1366 microversion: 2.1 time: 0.161981 Jul 05 21:02:46.434322 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 402/824] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 21:02:46 2022] GET /compute/v2.1/servers/db7345ee-2fba-477b-8841-dc561c29e754 => generated 1366 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 21:02:47.206642 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-c8b56253-1351-447a-828d-65067f00a1db tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 21:02:47.207249 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-c8b56253-1351-447a-828d-65067f00a1db tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] [instance: 31d561da-981c-4461-ac77-28d08ec752ad] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 21:02:47.209132 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG dbcounter [-] [117628] Writing DB stats nova_cell0:SELECT=10 {{(pid=117628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:02:47.215047 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-c8b56253-1351-447a-828d-65067f00a1db tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:02:47.215500 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-c8b56253-1351-447a-828d-65067f00a1db tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:02:47.216394 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-c8b56253-1351-447a-828d-65067f00a1db tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:02:47.216825 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-c8b56253-1351-447a-828d-65067f00a1db tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:02:47.346943 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-c8b56253-1351-447a-828d-65067f00a1db tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '261feb03a8ff459b8874232bec05034f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9a3d56f8b84eb2a057425afbf79079', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 21:02:47.354432 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-c8b56253-1351-447a-828d-65067f00a1db tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] 10.222.0.20 "GET /compute/v2.1/servers/31d561da-981c-4461-ac77-28d08ec752ad" status: 200 len: 1265 microversion: 2.1 time: 0.151891 Jul 05 21:02:47.354993 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 423/825] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 21:02:47 2022] GET /compute/v2.1/servers/31d561da-981c-4461-ac77-28d08ec752ad => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 21:02:47.451463 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-0590322e-3068-436e-b10b-f283e3e0d748 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 21:02:47.452078 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-0590322e-3068-436e-b10b-f283e3e0d748 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] [instance: db7345ee-2fba-477b-8841-dc561c29e754] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 21:02:47.458513 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-0590322e-3068-436e-b10b-f283e3e0d748 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:02:47.458961 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-0590322e-3068-436e-b10b-f283e3e0d748 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:02:47.459711 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-0590322e-3068-436e-b10b-f283e3e0d748 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:02:47.460152 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-0590322e-3068-436e-b10b-f283e3e0d748 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:02:47.590967 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-0590322e-3068-436e-b10b-f283e3e0d748 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e12538a6dd44bdd963e9850c24c04bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e74557ea7f0f4057b190c0adaaa80ed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 21:02:47.598447 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-0590322e-3068-436e-b10b-f283e3e0d748 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] 10.222.0.20 "GET /compute/v2.1/servers/db7345ee-2fba-477b-8841-dc561c29e754" status: 200 len: 1556 microversion: 2.1 time: 0.151598 Jul 05 21:02:47.598997 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 403/826] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 21:02:47 2022] GET /compute/v2.1/servers/db7345ee-2fba-477b-8841-dc561c29e754 => generated 1556 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 21:02:47.615097 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-643c76bb-8517-436d-bd9a-7cbdac028b61 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 21:02:47.615581 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-643c76bb-8517-436d-bd9a-7cbdac028b61 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] [instance: db7345ee-2fba-477b-8841-dc561c29e754] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 21:02:47.621572 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-643c76bb-8517-436d-bd9a-7cbdac028b61 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:02:47.622634 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-643c76bb-8517-436d-bd9a-7cbdac028b61 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:02:47.623383 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-643c76bb-8517-436d-bd9a-7cbdac028b61 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:02:47.623811 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-643c76bb-8517-436d-bd9a-7cbdac028b61 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:02:47.698661 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-643c76bb-8517-436d-bd9a-7cbdac028b61 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] 10.222.0.20 "GET /compute/v2.1/servers/db7345ee-2fba-477b-8841-dc561c29e754/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.087358 Jul 05 21:02:47.699260 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 424/827] 10.222.0.20 () {58 vars in 1274 bytes} [Tue Jul 5 21:02:47 2022] GET /compute/v2.1/servers/db7345ee-2fba-477b-8841-dc561c29e754/os-interface => generated 284 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 05 21:02:48.371348 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-5e3edfe1-6f63-4fdd-8179-b42a1acd610d tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 21:02:48.371966 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-5e3edfe1-6f63-4fdd-8179-b42a1acd610d tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] [instance: 31d561da-981c-4461-ac77-28d08ec752ad] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 21:02:48.378269 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-5e3edfe1-6f63-4fdd-8179-b42a1acd610d tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:02:48.378705 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-5e3edfe1-6f63-4fdd-8179-b42a1acd610d tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:02:48.379481 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-5e3edfe1-6f63-4fdd-8179-b42a1acd610d tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:02:48.379918 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-5e3edfe1-6f63-4fdd-8179-b42a1acd610d tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:02:48.515493 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [req-5bb06e76-3f0d-4796-a5c0-379eb5bc575a req-a181593c-aaa4-40e3-8db3-09dc1c5b0ce3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31d561da-981c-4461-ac77-28d08ec752ad", "name": "network-vif-plugged", "status": "completed", "tag": "c770b7ee-822c-4aa2-aba0-ca803c58e3b4"}]} {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 21:02:48.526614 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [req-5bb06e76-3f0d-4796-a5c0-379eb5bc575a req-a181593c-aaa4-40e3-8db3-09dc1c5b0ce3 service nova] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:02:48.527607 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [req-5bb06e76-3f0d-4796-a5c0-379eb5bc575a req-a181593c-aaa4-40e3-8db3-09dc1c5b0ce3 service nova] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:02:48.542447 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.compute.server_external_events [req-5bb06e76-3f0d-4796-a5c0-379eb5bc575a req-a181593c-aaa4-40e3-8db3-09dc1c5b0ce3 service nova] Creating event network-vif-plugged:c770b7ee-822c-4aa2-aba0-ca803c58e3b4 for instance 31d561da-981c-4461-ac77-28d08ec752ad on hv-cinder-79760 Jul 05 21:02:48.547971 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [req-5bb06e76-3f0d-4796-a5c0-379eb5bc575a req-a181593c-aaa4-40e3-8db3-09dc1c5b0ce3 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036602 Jul 05 21:02:48.548634 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 425/828] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 5 21:02:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 05 21:02:48.853267 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-5e3edfe1-6f63-4fdd-8179-b42a1acd610d tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '261feb03a8ff459b8874232bec05034f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9a3d56f8b84eb2a057425afbf79079', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 21:02:48.862243 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-5e3edfe1-6f63-4fdd-8179-b42a1acd610d tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] 10.222.0.20 "GET /compute/v2.1/servers/31d561da-981c-4461-ac77-28d08ec752ad" status: 200 len: 1265 microversion: 2.1 time: 0.494680 Jul 05 21:02:48.862844 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 404/829] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 21:02:48 2022] GET /compute/v2.1/servers/31d561da-981c-4461-ac77-28d08ec752ad => generated 1265 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 21:02:48.997989 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [req-36ab4d5a-2dea-4284-8230-eeb0926959e9 req-912d0282-7e06-453e-8e95-112715838d64 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "db7345ee-2fba-477b-8841-dc561c29e754", "tag": "2af3ace7-9b55-4a90-8437-021f139a1eb4"}]} {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 21:02:49.006141 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [req-36ab4d5a-2dea-4284-8230-eeb0926959e9 req-912d0282-7e06-453e-8e95-112715838d64 service nova] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:02:49.006581 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [req-36ab4d5a-2dea-4284-8230-eeb0926959e9 req-912d0282-7e06-453e-8e95-112715838d64 service nova] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:02:49.020364 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.compute.server_external_events [req-36ab4d5a-2dea-4284-8230-eeb0926959e9 req-912d0282-7e06-453e-8e95-112715838d64 service nova] Creating event network-changed:2af3ace7-9b55-4a90-8437-021f139a1eb4 for instance db7345ee-2fba-477b-8841-dc561c29e754 on hv-cinder-79760 Jul 05 21:02:49.025335 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [req-36ab4d5a-2dea-4284-8230-eeb0926959e9 req-912d0282-7e06-453e-8e95-112715838d64 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031889 Jul 05 21:02:49.026013 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 426/830] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 5 21:02:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 21:02:49.879961 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-1ed06f6c-b8af-4227-a9c0-4fd113d69607 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 21:02:49.880702 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-1ed06f6c-b8af-4227-a9c0-4fd113d69607 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] [instance: 31d561da-981c-4461-ac77-28d08ec752ad] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 21:02:49.887030 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-1ed06f6c-b8af-4227-a9c0-4fd113d69607 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:02:49.888083 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-1ed06f6c-b8af-4227-a9c0-4fd113d69607 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:02:49.889041 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-1ed06f6c-b8af-4227-a9c0-4fd113d69607 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:02:49.889544 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-1ed06f6c-b8af-4227-a9c0-4fd113d69607 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:02:50.021728 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-1ed06f6c-b8af-4227-a9c0-4fd113d69607 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '261feb03a8ff459b8874232bec05034f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9a3d56f8b84eb2a057425afbf79079', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 21:02:50.030306 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-1ed06f6c-b8af-4227-a9c0-4fd113d69607 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] 10.222.0.20 "GET /compute/v2.1/servers/31d561da-981c-4461-ac77-28d08ec752ad" status: 200 len: 1265 microversion: 2.1 time: 0.155059 Jul 05 21:02:50.031083 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 405/831] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 21:02:49 2022] GET /compute/v2.1/servers/31d561da-981c-4461-ac77-28d08ec752ad => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 21:02:51.049392 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-875d3bec-343a-44a7-939c-b2f364ace1af tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 21:02:51.050086 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-875d3bec-343a-44a7-939c-b2f364ace1af tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] [instance: 31d561da-981c-4461-ac77-28d08ec752ad] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 21:02:51.056402 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-875d3bec-343a-44a7-939c-b2f364ace1af tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:02:51.056842 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-875d3bec-343a-44a7-939c-b2f364ace1af tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:02:51.057616 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-875d3bec-343a-44a7-939c-b2f364ace1af tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:02:51.058045 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-875d3bec-343a-44a7-939c-b2f364ace1af tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:02:51.192974 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-875d3bec-343a-44a7-939c-b2f364ace1af tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '261feb03a8ff459b8874232bec05034f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9a3d56f8b84eb2a057425afbf79079', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 21:02:51.201466 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-875d3bec-343a-44a7-939c-b2f364ace1af tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] 10.222.0.20 "GET /compute/v2.1/servers/31d561da-981c-4461-ac77-28d08ec752ad" status: 200 len: 1451 microversion: 2.1 time: 0.157710 Jul 05 21:02:51.202046 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 427/832] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 21:02:51 2022] GET /compute/v2.1/servers/31d561da-981c-4461-ac77-28d08ec752ad => generated 1451 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 21:02:51.218551 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-60895a25-1616-4ca5-8244-8be7e30688cc tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 21:02:51.219159 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-60895a25-1616-4ca5-8244-8be7e30688cc tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] [instance: 31d561da-981c-4461-ac77-28d08ec752ad] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 21:02:51.225672 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-60895a25-1616-4ca5-8244-8be7e30688cc tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:02:51.226120 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-60895a25-1616-4ca5-8244-8be7e30688cc tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:02:51.226874 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-60895a25-1616-4ca5-8244-8be7e30688cc tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:02:51.227309 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-60895a25-1616-4ca5-8244-8be7e30688cc tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:02:51.355446 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-60895a25-1616-4ca5-8244-8be7e30688cc tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '261feb03a8ff459b8874232bec05034f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9a3d56f8b84eb2a057425afbf79079', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 21:02:51.363120 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-60895a25-1616-4ca5-8244-8be7e30688cc tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] 10.222.0.20 "GET /compute/v2.1/servers/31d561da-981c-4461-ac77-28d08ec752ad" status: 200 len: 1451 microversion: 2.1 time: 0.149358 Jul 05 21:02:51.363684 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 406/833] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 21:02:51 2022] GET /compute/v2.1/servers/31d561da-981c-4461-ac77-28d08ec752ad => generated 1451 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 21:02:53.095097 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [req-bbc91e06-705a-455d-9164-c0a1ad35eb43 req-2e79156e-96e5-4608-8264-373786280306 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "31d561da-981c-4461-ac77-28d08ec752ad", "tag": "c770b7ee-822c-4aa2-aba0-ca803c58e3b4"}]} {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 21:02:53.103459 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [req-bbc91e06-705a-455d-9164-c0a1ad35eb43 req-2e79156e-96e5-4608-8264-373786280306 service nova] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:02:53.103926 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [req-bbc91e06-705a-455d-9164-c0a1ad35eb43 req-2e79156e-96e5-4608-8264-373786280306 service nova] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:02:53.116138 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.compute.server_external_events [req-bbc91e06-705a-455d-9164-c0a1ad35eb43 req-2e79156e-96e5-4608-8264-373786280306 service nova] Creating event network-changed:c770b7ee-822c-4aa2-aba0-ca803c58e3b4 for instance 31d561da-981c-4461-ac77-28d08ec752ad on hv-cinder-79760 Jul 05 21:02:53.121869 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [req-bbc91e06-705a-455d-9164-c0a1ad35eb43 req-2e79156e-96e5-4608-8264-373786280306 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031093 Jul 05 21:02:53.123062 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 428/834] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 5 21:02:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 05 21:03:24.826185 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-23fb34c5-fd81-46cc-bdf9-faa7fa760999 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 21:03:24.826760 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-23fb34c5-fd81-46cc-bdf9-faa7fa760999 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] [instance: db7345ee-2fba-477b-8841-dc561c29e754] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 21:03:24.828685 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG dbcounter [-] [117627] Writing DB stats nova_api:SELECT=56,nova_api:INSERT=4 {{(pid=117627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:03:24.829345 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG dbcounter [-] [117627] Writing DB stats nova_cell1:SELECT=78 {{(pid=117627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:03:24.836041 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-23fb34c5-fd81-46cc-bdf9-faa7fa760999 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:03:24.836485 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-23fb34c5-fd81-46cc-bdf9-faa7fa760999 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:03:24.837503 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-23fb34c5-fd81-46cc-bdf9-faa7fa760999 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:03:24.837935 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-23fb34c5-fd81-46cc-bdf9-faa7fa760999 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:03:24.862355 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-23fb34c5-fd81-46cc-bdf9-faa7fa760999 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] 10.222.0.20 "GET /compute/v2.1/servers/db7345ee-2fba-477b-8841-dc561c29e754/ips" status: 200 len: 149 microversion: 2.1 time: 0.041199 Jul 05 21:03:24.862904 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 407/835] 10.222.0.20 () {58 vars in 1247 bytes} [Tue Jul 5 21:03:24 2022] GET /compute/v2.1/servers/db7345ee-2fba-477b-8841-dc561c29e754/ips => generated 149 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 05 21:03:24.872149 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG dbcounter [-] [117628] Writing DB stats nova_api:SELECT=57,nova_api:INSERT=3 {{(pid=117628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:03:24.873011 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG dbcounter [-] [117628] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:03:24.879023 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-b31f9db8-4df4-477b-82a9-dfb02d066759 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9a807808-4117-4dc3-93eb-f1d09411ebd4"}} {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 21:03:24.880260 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-b31f9db8-4df4-477b-82a9-dfb02d066759 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] [instance: db7345ee-2fba-477b-8841-dc561c29e754] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 21:03:24.891904 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-b31f9db8-4df4-477b-82a9-dfb02d066759 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:03:24.892345 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-b31f9db8-4df4-477b-82a9-dfb02d066759 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:03:24.893140 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-b31f9db8-4df4-477b-82a9-dfb02d066759 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:03:24.893571 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-b31f9db8-4df4-477b-82a9-dfb02d066759 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:03:24.979794 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.wsgi [None req-b31f9db8-4df4-477b-82a9-dfb02d066759 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] HTTP exception thrown: Invalid volume: volume 9a807808-4117-4dc3-93eb-f1d09411ebd4 is already attached to instances: 90cfd865-c450-453f-b03d-8c7e897ef805 Jul 05 21:03:24.982718 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-b31f9db8-4df4-477b-82a9-dfb02d066759 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Request method failure captured: Jul 05 21:03:24.982718 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: request: POST /compute/v2.1/servers/db7345ee-2fba-477b-8841-dc561c29e754/os-volume_attachments HTTP/1.1 Jul 05 21:03:24.982718 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: Accept: application/json Jul 05 21:03:24.982718 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: Accept-Encoding: identity Jul 05 21:03:24.982718 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: Connection: close Jul 05 21:03:24.982718 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: Content-Length: 74 Jul 05 21:03:24.982718 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: Content-Type: application/json Jul 05 21:03:24.982718 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: Host: 10.222.0.20 Jul 05 21:03:24.982718 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: Openstack-System-Scope: None Jul 05 21:03:24.982718 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: User-Agent: python-urllib3/1.26.9 Jul 05 21:03:24.982718 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Auth-Token: gAAAAABixKarHgq3GWxRAKGmFwqIOMVjxqRQFJ7-2_sqqMtaV9JHslnOGPoR_FnpEoGbLd0ulAIzNEyJKhgb_3l9UkX5Mn7TVDtn4GMWZ4xzhovIj2rt_z9oCnXCy_kxP3BJwmRcgYkKaWq3r03wWEMey-TXfn-Y_kpgbvCo-kJFjtitnsjsr2E Jul 05 21:03:24.982718 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Domain-Id: None Jul 05 21:03:24.982718 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Domain-Name: None Jul 05 21:03:24.982718 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Identity-Status: Confirmed Jul 05 21:03:24.982718 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Is-Admin-Project: True Jul 05 21:03:24.982718 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Project-Domain-Id: default Jul 05 21:03:24.982718 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Project-Domain-Name: Default Jul 05 21:03:24.982718 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Project-Id: e74557ea7f0f4057b190c0adaaa80ed9 Jul 05 21:03:24.982718 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Project-Name: tempest-AttachVolumeNegativeTest-1927644848 Jul 05 21:03:24.982718 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Role: member,reader Jul 05 21:03:24.982718 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Roles: member,reader Jul 05 21:03:24.984453 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e74557ea7f0f4057b190c0adaaa80ed9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/e74557ea7f0f4057b190c0adaaa80ed9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_e74557ea7f0f4057b190c0adaaa80ed9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e74557ea7f0f4057b190c0adaaa80ed9"}]}] Jul 05 21:03:24.984453 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Tenant: tempest-AttachVolumeNegativeTest-1927644848 Jul 05 21:03:24.984453 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Tenant-Id: e74557ea7f0f4057b190c0adaaa80ed9 Jul 05 21:03:24.984453 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1927644848 Jul 05 21:03:24.984453 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-User: tempest-AttachVolumeNegativeTest-1927644848-project Jul 05 21:03:24.984453 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-User-Domain-Id: default Jul 05 21:03:24.984453 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-User-Domain-Name: Default Jul 05 21:03:24.984453 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-User-Id: 0e12538a6dd44bdd963e9850c24c04bc Jul 05 21:03:24.984453 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-User-Name: tempest-AttachVolumeNegativeTest-1927644848-project Jul 05 21:03:24.984453 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: Jul 05 21:03:24.984453 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: {"volumeAttachment": {"volumeId": "9a807808-4117-4dc3-93eb-f1d09411ebd4"}} Jul 05 21:03:24.984453 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: method: > Jul 05 21:03:24.986287 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: exception: Invalid volume: volume 9a807808-4117-4dc3-93eb-f1d09411ebd4 is already attached to instances: 90cfd865-c450-453f-b03d-8c7e897ef805 Jul 05 21:03:24.986287 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: action_args: {'server_id': 'db7345ee-2fba-477b-8841-dc561c29e754', 'body': {'volumeAttachment': {'volumeId': '9a807808-4117-4dc3-93eb-f1d09411ebd4'}}} Jul 05 21:03:24.986287 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 05 21:03:24.986287 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 21:03:24.986287 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 05 21:03:24.986287 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 05 21:03:24.986287 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 05 21:03:24.986287 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 05 21:03:24.986287 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 05 21:03:24.986287 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 05 21:03:24.986287 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jul 05 21:03:24.986287 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 05 21:03:24.986287 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jul 05 21:03:24.986287 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 05 21:03:24.986287 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 9a807808-4117-4dc3-93eb-f1d09411ebd4 is already attached to instances: 90cfd865-c450-453f-b03d-8c7e897ef805 Jul 05 21:03:24.986287 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi Jul 05 21:03:24.986287 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 21:03:24.986287 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi Jul 05 21:03:24.986287 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 21:03:24.987912 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 21:03:24.987912 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 21:03:24.987912 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 05 21:03:24.987912 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 05 21:03:24.987912 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 05 21:03:24.987912 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 05 21:03:24.987912 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 05 21:03:24.987912 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 05 21:03:24.987912 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 05 21:03:24.987912 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 05 21:03:24.987912 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 05 21:03:24.987912 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 05 21:03:24.987912 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 05 21:03:24.987912 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 05 21:03:24.987912 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 9a807808-4117-4dc3-93eb-f1d09411ebd4 is already attached to instances: 90cfd865-c450-453f-b03d-8c7e897ef805 Jul 05 21:03:24.987912 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi Jul 05 21:03:24.987912 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 21:03:24.987912 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi Jul 05 21:03:24.987912 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 21:03:24.987912 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 21:03:24.989499 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 21:03:24.989499 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 05 21:03:24.989499 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 05 21:03:24.989499 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 9a807808-4117-4dc3-93eb-f1d09411ebd4 is already attached to instances: 90cfd865-c450-453f-b03d-8c7e897ef805 Jul 05 21:03:24.989499 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi Jul 05 21:03:24.989499 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-b31f9db8-4df4-477b-82a9-dfb02d066759 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Returning 400 to user: Invalid volume: volume 9a807808-4117-4dc3-93eb-f1d09411ebd4 is already attached to instances: 90cfd865-c450-453f-b03d-8c7e897ef805 {{(pid=117628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 05 21:03:24.989499 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-b31f9db8-4df4-477b-82a9-dfb02d066759 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] 10.222.0.20 "POST /compute/v2.1/servers/db7345ee-2fba-477b-8841-dc561c29e754/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.114775 Jul 05 21:03:24.989499 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 429/836] 10.222.0.20 () {60 vars in 1322 bytes} [Tue Jul 5 21:03:24 2022] POST /compute/v2.1/servers/db7345ee-2fba-477b-8841-dc561c29e754/os-volume_attachments => generated 174 bytes in 116 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 05 21:03:24.992691 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-847335fb-fa27-470c-b4d3-b903529026b3 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 21:03:24.993228 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-847335fb-fa27-470c-b4d3-b903529026b3 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] [instance: db7345ee-2fba-477b-8841-dc561c29e754] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 21:03:25.000309 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-847335fb-fa27-470c-b4d3-b903529026b3 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:03:25.000755 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-847335fb-fa27-470c-b4d3-b903529026b3 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:03:25.001529 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-847335fb-fa27-470c-b4d3-b903529026b3 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:03:25.001960 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-847335fb-fa27-470c-b4d3-b903529026b3 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:03:25.026062 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-847335fb-fa27-470c-b4d3-b903529026b3 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] [instance: db7345ee-2fba-477b-8841-dc561c29e754] Going to try to terminate instance {{(pid=117627) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 05 21:03:25.111064 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-847335fb-fa27-470c-b4d3-b903529026b3 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] 10.222.0.20 "DELETE /compute/v2.1/servers/db7345ee-2fba-477b-8841-dc561c29e754" status: 204 len: 0 microversion: 2.1 time: 0.121682 Jul 05 21:03:25.111570 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 408/837] 10.222.0.20 () {58 vars in 1238 bytes} [Tue Jul 5 21:03:24 2022] DELETE /compute/v2.1/servers/db7345ee-2fba-477b-8841-dc561c29e754 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 05 21:03:25.120005 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-8a240bf8-a272-4c5e-913a-5fe1c583a52f tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 21:03:25.120617 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-8a240bf8-a272-4c5e-913a-5fe1c583a52f tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] [instance: db7345ee-2fba-477b-8841-dc561c29e754] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 21:03:25.128907 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-8a240bf8-a272-4c5e-913a-5fe1c583a52f tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:03:25.129399 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-8a240bf8-a272-4c5e-913a-5fe1c583a52f tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:03:25.130186 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-8a240bf8-a272-4c5e-913a-5fe1c583a52f tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:03:25.130595 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-8a240bf8-a272-4c5e-913a-5fe1c583a52f tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:03:25.260647 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-8a240bf8-a272-4c5e-913a-5fe1c583a52f tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e12538a6dd44bdd963e9850c24c04bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e74557ea7f0f4057b190c0adaaa80ed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 21:03:25.268945 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-8a240bf8-a272-4c5e-913a-5fe1c583a52f tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] 10.222.0.20 "GET /compute/v2.1/servers/db7345ee-2fba-477b-8841-dc561c29e754" status: 200 len: 1680 microversion: 2.1 time: 0.152842 Jul 05 21:03:25.269507 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 430/838] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 21:03:25 2022] GET /compute/v2.1/servers/db7345ee-2fba-477b-8841-dc561c29e754 => generated 1680 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 21:03:26.287965 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-9689197a-06df-4ac8-9f10-c051b34a916c tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 21:03:26.288661 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-9689197a-06df-4ac8-9f10-c051b34a916c tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] [instance: db7345ee-2fba-477b-8841-dc561c29e754] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 21:03:26.295295 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-9689197a-06df-4ac8-9f10-c051b34a916c tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:03:26.295738 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-9689197a-06df-4ac8-9f10-c051b34a916c tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:03:26.296488 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-9689197a-06df-4ac8-9f10-c051b34a916c tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:03:26.296920 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-9689197a-06df-4ac8-9f10-c051b34a916c tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:03:26.430123 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-9689197a-06df-4ac8-9f10-c051b34a916c tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e12538a6dd44bdd963e9850c24c04bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e74557ea7f0f4057b190c0adaaa80ed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 21:03:26.438154 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-9689197a-06df-4ac8-9f10-c051b34a916c tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] 10.222.0.20 "GET /compute/v2.1/servers/db7345ee-2fba-477b-8841-dc561c29e754" status: 200 len: 1680 microversion: 2.1 time: 0.154453 Jul 05 21:03:26.438719 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 409/839] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 21:03:26 2022] GET /compute/v2.1/servers/db7345ee-2fba-477b-8841-dc561c29e754 => generated 1680 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 21:03:27.460005 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-932a61a4-c94a-4d73-ab33-26a8c57a448b tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 21:03:27.460640 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-932a61a4-c94a-4d73-ab33-26a8c57a448b tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] [instance: db7345ee-2fba-477b-8841-dc561c29e754] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 21:03:27.469006 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-932a61a4-c94a-4d73-ab33-26a8c57a448b tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:03:27.469462 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-932a61a4-c94a-4d73-ab33-26a8c57a448b tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:03:27.470241 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-932a61a4-c94a-4d73-ab33-26a8c57a448b tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:03:27.470678 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-932a61a4-c94a-4d73-ab33-26a8c57a448b tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:03:27.545727 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-932a61a4-c94a-4d73-ab33-26a8c57a448b tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e12538a6dd44bdd963e9850c24c04bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e74557ea7f0f4057b190c0adaaa80ed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 21:03:27.553292 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-932a61a4-c94a-4d73-ab33-26a8c57a448b tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] 10.222.0.20 "GET /compute/v2.1/servers/db7345ee-2fba-477b-8841-dc561c29e754" status: 200 len: 1613 microversion: 2.1 time: 0.100557 Jul 05 21:03:27.564914 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 431/840] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 21:03:27 2022] GET /compute/v2.1/servers/db7345ee-2fba-477b-8841-dc561c29e754 => generated 1613 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 21:03:27.613930 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [req-4b000c16-8ba3-44d5-93ec-8020236bada1 req-91c37711-0c67-48ed-b85b-5b20b8a44991 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db7345ee-2fba-477b-8841-dc561c29e754", "name": "network-vif-deleted", "tag": "2af3ace7-9b55-4a90-8437-021f139a1eb4"}]} {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 21:03:27.624489 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [req-4b000c16-8ba3-44d5-93ec-8020236bada1 req-91c37711-0c67-48ed-b85b-5b20b8a44991 service nova] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:03:27.635380 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [req-4b000c16-8ba3-44d5-93ec-8020236bada1 req-91c37711-0c67-48ed-b85b-5b20b8a44991 service nova] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:03:27.657076 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.compute.server_external_events [req-4b000c16-8ba3-44d5-93ec-8020236bada1 req-91c37711-0c67-48ed-b85b-5b20b8a44991 service nova] Creating event network-vif-deleted:2af3ace7-9b55-4a90-8437-021f139a1eb4 for instance db7345ee-2fba-477b-8841-dc561c29e754 on hv-cinder-79760 Jul 05 21:03:27.662706 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [req-4b000c16-8ba3-44d5-93ec-8020236bada1 req-91c37711-0c67-48ed-b85b-5b20b8a44991 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053070 Jul 05 21:03:27.664021 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 410/841] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 5 21:03:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 21:03:28.571750 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-32cc98b6-e93a-45d3-b415-3bd9bcca0f75 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 21:03:28.572791 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-32cc98b6-e93a-45d3-b415-3bd9bcca0f75 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] [instance: db7345ee-2fba-477b-8841-dc561c29e754] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 21:03:28.582000 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-32cc98b6-e93a-45d3-b415-3bd9bcca0f75 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:03:28.582521 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-32cc98b6-e93a-45d3-b415-3bd9bcca0f75 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:03:28.583315 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-32cc98b6-e93a-45d3-b415-3bd9bcca0f75 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:03:28.583770 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-32cc98b6-e93a-45d3-b415-3bd9bcca0f75 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:03:28.599199 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.wsgi [None req-32cc98b6-e93a-45d3-b415-3bd9bcca0f75 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] HTTP exception thrown: Instance db7345ee-2fba-477b-8841-dc561c29e754 could not be found. Jul 05 21:03:28.600738 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-32cc98b6-e93a-45d3-b415-3bd9bcca0f75 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Request method failure captured: Jul 05 21:03:28.600738 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: request: GET /compute/v2.1/servers/db7345ee-2fba-477b-8841-dc561c29e754 HTTP/1.1 Jul 05 21:03:28.600738 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: Accept: application/json Jul 05 21:03:28.600738 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: Accept-Encoding: identity Jul 05 21:03:28.600738 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: Connection: close Jul 05 21:03:28.600738 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: Content-Length: 0 Jul 05 21:03:28.600738 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: Content-Type: application/json Jul 05 21:03:28.600738 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: Host: 10.222.0.20 Jul 05 21:03:28.600738 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: Openstack-System-Scope: None Jul 05 21:03:28.600738 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: User-Agent: python-urllib3/1.26.9 Jul 05 21:03:28.600738 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Auth-Token: gAAAAABixKarHgq3GWxRAKGmFwqIOMVjxqRQFJ7-2_sqqMtaV9JHslnOGPoR_FnpEoGbLd0ulAIzNEyJKhgb_3l9UkX5Mn7TVDtn4GMWZ4xzhovIj2rt_z9oCnXCy_kxP3BJwmRcgYkKaWq3r03wWEMey-TXfn-Y_kpgbvCo-kJFjtitnsjsr2E Jul 05 21:03:28.600738 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Domain-Id: None Jul 05 21:03:28.600738 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Domain-Name: None Jul 05 21:03:28.600738 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Identity-Status: Confirmed Jul 05 21:03:28.600738 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Is-Admin-Project: True Jul 05 21:03:28.600738 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Project-Domain-Id: default Jul 05 21:03:28.600738 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Project-Domain-Name: Default Jul 05 21:03:28.600738 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Project-Id: e74557ea7f0f4057b190c0adaaa80ed9 Jul 05 21:03:28.600738 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Project-Name: tempest-AttachVolumeNegativeTest-1927644848 Jul 05 21:03:28.600738 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Role: member,reader Jul 05 21:03:28.600738 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Roles: member,reader Jul 05 21:03:28.602435 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e74557ea7f0f4057b190c0adaaa80ed9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/e74557ea7f0f4057b190c0adaaa80ed9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_e74557ea7f0f4057b190c0adaaa80ed9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e74557ea7f0f4057b190c0adaaa80ed9"}]}] Jul 05 21:03:28.602435 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Tenant: tempest-AttachVolumeNegativeTest-1927644848 Jul 05 21:03:28.602435 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Tenant-Id: e74557ea7f0f4057b190c0adaaa80ed9 Jul 05 21:03:28.602435 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1927644848 Jul 05 21:03:28.602435 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-User: tempest-AttachVolumeNegativeTest-1927644848-project Jul 05 21:03:28.602435 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-User-Domain-Id: default Jul 05 21:03:28.602435 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-User-Domain-Name: Default Jul 05 21:03:28.602435 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-User-Id: 0e12538a6dd44bdd963e9850c24c04bc Jul 05 21:03:28.602435 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-User-Name: tempest-AttachVolumeNegativeTest-1927644848-project Jul 05 21:03:28.602435 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: method: > Jul 05 21:03:28.602435 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: exception: Instance db7345ee-2fba-477b-8841-dc561c29e754 could not be found. Jul 05 21:03:28.602435 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: action_args: {'id': 'db7345ee-2fba-477b-8841-dc561c29e754'} Jul 05 21:03:28.603288 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 05 21:03:28.603288 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 21:03:28.603288 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 05 21:03:28.603288 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 05 21:03:28.603288 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 05 21:03:28.603288 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 05 21:03:28.603288 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 05 21:03:28.603288 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 05 21:03:28.603288 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 05 21:03:28.603288 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 05 21:03:28.603288 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance db7345ee-2fba-477b-8841-dc561c29e754 could not be found. Jul 05 21:03:28.603288 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi Jul 05 21:03:28.603288 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 21:03:28.603288 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi Jul 05 21:03:28.603288 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 21:03:28.603288 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 21:03:28.603288 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 21:03:28.603288 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 05 21:03:28.603288 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 05 21:03:28.603288 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 05 21:03:28.604668 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 05 21:03:28.604668 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 05 21:03:28.604668 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 05 21:03:28.604668 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 05 21:03:28.604668 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 05 21:03:28.604668 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 05 21:03:28.604668 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 05 21:03:28.604668 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance db7345ee-2fba-477b-8841-dc561c29e754 could not be found. Jul 05 21:03:28.604668 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi Jul 05 21:03:28.604668 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 21:03:28.604668 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi Jul 05 21:03:28.604668 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 21:03:28.604668 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 21:03:28.604668 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 21:03:28.604668 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 05 21:03:28.604668 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 05 21:03:28.604668 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance db7345ee-2fba-477b-8841-dc561c29e754 could not be found. Jul 05 21:03:28.604668 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi Jul 05 21:03:28.606621 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-32cc98b6-e93a-45d3-b415-3bd9bcca0f75 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Returning 404 to user: Instance db7345ee-2fba-477b-8841-dc561c29e754 could not be found. {{(pid=117628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 05 21:03:28.606621 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-32cc98b6-e93a-45d3-b415-3bd9bcca0f75 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] 10.222.0.20 "GET /compute/v2.1/servers/db7345ee-2fba-477b-8841-dc561c29e754" status: 404 len: 111 microversion: 2.1 time: 0.034474 Jul 05 21:03:28.606621 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 432/842] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 21:03:28 2022] GET /compute/v2.1/servers/db7345ee-2fba-477b-8841-dc561c29e754 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 05 21:03:28.612503 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-26e1bd87-b681-4827-97b2-e8bc4921cd59 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Calling method '.version_select at 0x7f57cdef8310>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 21:03:28.632750 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-26e1bd87-b681-4827-97b2-e8bc4921cd59 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-436572042" status: 202 len: 0 microversion: 2.1 time: 0.024196 Jul 05 21:03:28.633440 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 411/843] 10.222.0.20 () {58 vars in 1217 bytes} [Tue Jul 5 21:03:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-436572042 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 05 21:03:29.287561 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-c01ffe93-7687-4a0e-a755-dc85e750d975 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 21:03:29.288045 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-c01ffe93-7687-4a0e-a755-dc85e750d975 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] [instance: 90cfd865-c450-453f-b03d-8c7e897ef805] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 21:03:29.294668 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-c01ffe93-7687-4a0e-a755-dc85e750d975 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:03:29.295090 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-c01ffe93-7687-4a0e-a755-dc85e750d975 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:03:29.295837 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-c01ffe93-7687-4a0e-a755-dc85e750d975 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:03:29.296270 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-c01ffe93-7687-4a0e-a755-dc85e750d975 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:03:29.375214 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.objects.instance [None req-c01ffe93-7687-4a0e-a755-dc85e750d975 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lazy-loading 'services' on Instance uuid 90cfd865-c450-453f-b03d-8c7e897ef805 {{(pid=117628) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 05 21:03:29.488892 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-c01ffe93-7687-4a0e-a755-dc85e750d975 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] 10.222.0.20 "DELETE /compute/v2.1/servers/90cfd865-c450-453f-b03d-8c7e897ef805/os-volume_attachments/9a807808-4117-4dc3-93eb-f1d09411ebd4" status: 202 len: 0 microversion: 2.1 time: 0.204817 Jul 05 21:03:29.489506 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 433/844] 10.222.0.20 () {58 vars in 1415 bytes} [Tue Jul 5 21:03:29 2022] DELETE /compute/v2.1/servers/90cfd865-c450-453f-b03d-8c7e897ef805/os-volume_attachments/9a807808-4117-4dc3-93eb-f1d09411ebd4 => generated 0 bytes in 206 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 05 21:03:29.498791 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-dfe1a170-ba3b-47d6-a75f-11882c1dfd7f tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 21:03:29.499911 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-dfe1a170-ba3b-47d6-a75f-11882c1dfd7f tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] [instance: 90cfd865-c450-453f-b03d-8c7e897ef805] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 21:03:29.506987 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-dfe1a170-ba3b-47d6-a75f-11882c1dfd7f tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:03:29.507504 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-dfe1a170-ba3b-47d6-a75f-11882c1dfd7f tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:03:29.508368 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-dfe1a170-ba3b-47d6-a75f-11882c1dfd7f tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:03:29.508915 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-dfe1a170-ba3b-47d6-a75f-11882c1dfd7f tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:03:29.538681 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-dfe1a170-ba3b-47d6-a75f-11882c1dfd7f tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] 10.222.0.20 "GET /compute/v2.1/servers/90cfd865-c450-453f-b03d-8c7e897ef805/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044731 Jul 05 21:03:29.539316 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 412/845] 10.222.0.20 () {58 vars in 1301 bytes} [Tue Jul 5 21:03:29 2022] GET /compute/v2.1/servers/90cfd865-c450-453f-b03d-8c7e897ef805/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 21:03:30.551606 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-7b9a4ddb-2789-453c-829b-ee715448800f tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 21:03:30.552671 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-7b9a4ddb-2789-453c-829b-ee715448800f tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] [instance: 90cfd865-c450-453f-b03d-8c7e897ef805] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 21:03:30.559573 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-7b9a4ddb-2789-453c-829b-ee715448800f tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:03:30.560022 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-7b9a4ddb-2789-453c-829b-ee715448800f tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:03:30.560781 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-7b9a4ddb-2789-453c-829b-ee715448800f tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:03:30.561243 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-7b9a4ddb-2789-453c-829b-ee715448800f tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:03:30.589240 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-7b9a4ddb-2789-453c-829b-ee715448800f tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] 10.222.0.20 "GET /compute/v2.1/servers/90cfd865-c450-453f-b03d-8c7e897ef805/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041984 Jul 05 21:03:30.589786 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 434/846] 10.222.0.20 () {58 vars in 1301 bytes} [Tue Jul 5 21:03:30 2022] GET /compute/v2.1/servers/90cfd865-c450-453f-b03d-8c7e897ef805/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 05 21:03:30.648196 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-10b65e6c-ed2d-456e-b705-52e3579d77e2 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 21:03:30.648697 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-10b65e6c-ed2d-456e-b705-52e3579d77e2 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] [instance: 90cfd865-c450-453f-b03d-8c7e897ef805] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 21:03:30.656497 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-10b65e6c-ed2d-456e-b705-52e3579d77e2 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:03:30.656985 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-10b65e6c-ed2d-456e-b705-52e3579d77e2 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:03:30.657896 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-10b65e6c-ed2d-456e-b705-52e3579d77e2 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:03:30.658419 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-10b65e6c-ed2d-456e-b705-52e3579d77e2 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:03:30.684217 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-10b65e6c-ed2d-456e-b705-52e3579d77e2 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] [instance: 90cfd865-c450-453f-b03d-8c7e897ef805] Going to try to terminate instance {{(pid=117627) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 05 21:03:30.757868 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-10b65e6c-ed2d-456e-b705-52e3579d77e2 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] 10.222.0.20 "DELETE /compute/v2.1/servers/90cfd865-c450-453f-b03d-8c7e897ef805" status: 204 len: 0 microversion: 2.1 time: 0.113195 Jul 05 21:03:30.758461 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 413/847] 10.222.0.20 () {58 vars in 1238 bytes} [Tue Jul 5 21:03:30 2022] DELETE /compute/v2.1/servers/90cfd865-c450-453f-b03d-8c7e897ef805 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 05 21:03:30.767747 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-ce2258cb-dd9d-46db-ac85-3d7ae52429dc tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 21:03:30.768324 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-ce2258cb-dd9d-46db-ac85-3d7ae52429dc tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] [instance: 90cfd865-c450-453f-b03d-8c7e897ef805] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 21:03:30.775057 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-ce2258cb-dd9d-46db-ac85-3d7ae52429dc tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:03:30.775496 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-ce2258cb-dd9d-46db-ac85-3d7ae52429dc tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:03:30.776252 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-ce2258cb-dd9d-46db-ac85-3d7ae52429dc tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:03:30.776686 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-ce2258cb-dd9d-46db-ac85-3d7ae52429dc tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:03:30.909654 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-ce2258cb-dd9d-46db-ac85-3d7ae52429dc tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e12538a6dd44bdd963e9850c24c04bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e74557ea7f0f4057b190c0adaaa80ed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 21:03:30.917209 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-ce2258cb-dd9d-46db-ac85-3d7ae52429dc tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] 10.222.0.20 "GET /compute/v2.1/servers/90cfd865-c450-453f-b03d-8c7e897ef805" status: 200 len: 1682 microversion: 2.1 time: 0.154360 Jul 05 21:03:30.917770 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 435/848] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 21:03:30 2022] GET /compute/v2.1/servers/90cfd865-c450-453f-b03d-8c7e897ef805 => generated 1682 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 21:03:31.935871 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-82499a13-ebf5-45cb-8058-973ea8210b5f tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 21:03:31.936578 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-82499a13-ebf5-45cb-8058-973ea8210b5f tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] [instance: 90cfd865-c450-453f-b03d-8c7e897ef805] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 21:03:31.943027 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-82499a13-ebf5-45cb-8058-973ea8210b5f tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:03:31.943464 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-82499a13-ebf5-45cb-8058-973ea8210b5f tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:03:31.944208 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-82499a13-ebf5-45cb-8058-973ea8210b5f tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:03:31.944631 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-82499a13-ebf5-45cb-8058-973ea8210b5f tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:03:32.071429 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-82499a13-ebf5-45cb-8058-973ea8210b5f tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e12538a6dd44bdd963e9850c24c04bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e74557ea7f0f4057b190c0adaaa80ed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 21:03:32.078915 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-82499a13-ebf5-45cb-8058-973ea8210b5f tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] 10.222.0.20 "GET /compute/v2.1/servers/90cfd865-c450-453f-b03d-8c7e897ef805" status: 200 len: 1682 microversion: 2.1 time: 0.147870 Jul 05 21:03:32.079471 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 414/849] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 21:03:31 2022] GET /compute/v2.1/servers/90cfd865-c450-453f-b03d-8c7e897ef805 => generated 1682 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 21:03:33.096540 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-4f8e690c-0f74-471a-a377-96299f25d93a tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 21:03:33.097191 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-4f8e690c-0f74-471a-a377-96299f25d93a tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] [instance: 90cfd865-c450-453f-b03d-8c7e897ef805] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 21:03:33.103705 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-4f8e690c-0f74-471a-a377-96299f25d93a tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:03:33.104147 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-4f8e690c-0f74-471a-a377-96299f25d93a tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:03:33.104908 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-4f8e690c-0f74-471a-a377-96299f25d93a tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:03:33.105362 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-4f8e690c-0f74-471a-a377-96299f25d93a tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:03:33.312732 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-4f8e690c-0f74-471a-a377-96299f25d93a tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e12538a6dd44bdd963e9850c24c04bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e74557ea7f0f4057b190c0adaaa80ed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 21:03:33.322002 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-4f8e690c-0f74-471a-a377-96299f25d93a tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] 10.222.0.20 "GET /compute/v2.1/servers/90cfd865-c450-453f-b03d-8c7e897ef805" status: 200 len: 1682 microversion: 2.1 time: 0.229316 Jul 05 21:03:33.326027 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 436/850] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 21:03:33 2022] GET /compute/v2.1/servers/90cfd865-c450-453f-b03d-8c7e897ef805 => generated 1682 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 21:03:33.582902 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [req-e235289c-a2c1-439a-b2aa-1f4eae7db896 req-34c82312-5fce-47da-802b-b2d441c655ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "90cfd865-c450-453f-b03d-8c7e897ef805", "name": "network-vif-deleted", "tag": "c9cc78ae-754c-404b-9ff2-fd0891277d2e"}]} {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 21:03:33.595654 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [req-e235289c-a2c1-439a-b2aa-1f4eae7db896 req-34c82312-5fce-47da-802b-b2d441c655ce service nova] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:03:33.596236 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [req-e235289c-a2c1-439a-b2aa-1f4eae7db896 req-34c82312-5fce-47da-802b-b2d441c655ce service nova] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:03:33.609596 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.compute.server_external_events [req-e235289c-a2c1-439a-b2aa-1f4eae7db896 req-34c82312-5fce-47da-802b-b2d441c655ce service nova] Creating event network-vif-deleted:c9cc78ae-754c-404b-9ff2-fd0891277d2e for instance 90cfd865-c450-453f-b03d-8c7e897ef805 on hv-cinder-79760 Jul 05 21:03:33.615202 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [req-e235289c-a2c1-439a-b2aa-1f4eae7db896 req-34c82312-5fce-47da-802b-b2d441c655ce service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036229 Jul 05 21:03:33.615884 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 415/851] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 5 21:03:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 21:03:34.339557 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-52d1e53c-2983-4165-89cf-19b514035c33 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 21:03:34.341174 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-52d1e53c-2983-4165-89cf-19b514035c33 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] [instance: 90cfd865-c450-453f-b03d-8c7e897ef805] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 21:03:34.347936 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-52d1e53c-2983-4165-89cf-19b514035c33 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:03:34.348375 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-52d1e53c-2983-4165-89cf-19b514035c33 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:03:34.349210 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-52d1e53c-2983-4165-89cf-19b514035c33 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:03:34.349646 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-52d1e53c-2983-4165-89cf-19b514035c33 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:03:34.364807 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.wsgi [None req-52d1e53c-2983-4165-89cf-19b514035c33 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] HTTP exception thrown: Instance 90cfd865-c450-453f-b03d-8c7e897ef805 could not be found. Jul 05 21:03:34.366481 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-52d1e53c-2983-4165-89cf-19b514035c33 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Request method failure captured: Jul 05 21:03:34.366481 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: request: GET /compute/v2.1/servers/90cfd865-c450-453f-b03d-8c7e897ef805 HTTP/1.1 Jul 05 21:03:34.366481 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: Accept: application/json Jul 05 21:03:34.366481 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: Accept-Encoding: identity Jul 05 21:03:34.366481 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: Connection: close Jul 05 21:03:34.366481 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: Content-Length: 0 Jul 05 21:03:34.366481 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: Content-Type: application/json Jul 05 21:03:34.366481 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: Host: 10.222.0.20 Jul 05 21:03:34.366481 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: Openstack-System-Scope: None Jul 05 21:03:34.366481 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: User-Agent: python-urllib3/1.26.9 Jul 05 21:03:34.366481 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Auth-Token: gAAAAABixKarHgq3GWxRAKGmFwqIOMVjxqRQFJ7-2_sqqMtaV9JHslnOGPoR_FnpEoGbLd0ulAIzNEyJKhgb_3l9UkX5Mn7TVDtn4GMWZ4xzhovIj2rt_z9oCnXCy_kxP3BJwmRcgYkKaWq3r03wWEMey-TXfn-Y_kpgbvCo-kJFjtitnsjsr2E Jul 05 21:03:34.366481 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Domain-Id: None Jul 05 21:03:34.366481 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Domain-Name: None Jul 05 21:03:34.366481 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Identity-Status: Confirmed Jul 05 21:03:34.366481 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Is-Admin-Project: True Jul 05 21:03:34.366481 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Project-Domain-Id: default Jul 05 21:03:34.366481 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Project-Domain-Name: Default Jul 05 21:03:34.366481 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Project-Id: e74557ea7f0f4057b190c0adaaa80ed9 Jul 05 21:03:34.366481 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Project-Name: tempest-AttachVolumeNegativeTest-1927644848 Jul 05 21:03:34.366481 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Role: member,reader Jul 05 21:03:34.366481 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Roles: member,reader Jul 05 21:03:34.368115 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e74557ea7f0f4057b190c0adaaa80ed9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/e74557ea7f0f4057b190c0adaaa80ed9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_e74557ea7f0f4057b190c0adaaa80ed9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e74557ea7f0f4057b190c0adaaa80ed9"}]}] Jul 05 21:03:34.368115 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Tenant: tempest-AttachVolumeNegativeTest-1927644848 Jul 05 21:03:34.368115 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Tenant-Id: e74557ea7f0f4057b190c0adaaa80ed9 Jul 05 21:03:34.368115 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1927644848 Jul 05 21:03:34.368115 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-User: tempest-AttachVolumeNegativeTest-1927644848-project Jul 05 21:03:34.368115 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-User-Domain-Id: default Jul 05 21:03:34.368115 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-User-Domain-Name: Default Jul 05 21:03:34.368115 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-User-Id: 0e12538a6dd44bdd963e9850c24c04bc Jul 05 21:03:34.368115 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-User-Name: tempest-AttachVolumeNegativeTest-1927644848-project Jul 05 21:03:34.368115 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: method: > Jul 05 21:03:34.368115 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: exception: Instance 90cfd865-c450-453f-b03d-8c7e897ef805 could not be found. Jul 05 21:03:34.368115 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: action_args: {'id': '90cfd865-c450-453f-b03d-8c7e897ef805'} Jul 05 21:03:34.369021 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 05 21:03:34.369021 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 21:03:34.369021 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 05 21:03:34.369021 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 05 21:03:34.369021 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 05 21:03:34.369021 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 05 21:03:34.369021 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 05 21:03:34.369021 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 05 21:03:34.369021 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 05 21:03:34.369021 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 05 21:03:34.369021 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 90cfd865-c450-453f-b03d-8c7e897ef805 could not be found. Jul 05 21:03:34.369021 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi Jul 05 21:03:34.369021 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 21:03:34.369021 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi Jul 05 21:03:34.369021 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 21:03:34.369021 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 21:03:34.369021 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 21:03:34.369021 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 05 21:03:34.369021 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 05 21:03:34.369021 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 05 21:03:34.370557 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 05 21:03:34.370557 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 05 21:03:34.370557 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 05 21:03:34.370557 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 05 21:03:34.370557 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 05 21:03:34.370557 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 05 21:03:34.370557 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 05 21:03:34.370557 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 90cfd865-c450-453f-b03d-8c7e897ef805 could not be found. Jul 05 21:03:34.370557 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi Jul 05 21:03:34.370557 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 21:03:34.370557 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi Jul 05 21:03:34.370557 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 21:03:34.370557 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 21:03:34.370557 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 21:03:34.370557 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 05 21:03:34.370557 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 05 21:03:34.370557 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 90cfd865-c450-453f-b03d-8c7e897ef805 could not be found. Jul 05 21:03:34.370557 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi Jul 05 21:03:34.372505 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-52d1e53c-2983-4165-89cf-19b514035c33 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Returning 404 to user: Instance 90cfd865-c450-453f-b03d-8c7e897ef805 could not be found. {{(pid=117628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 05 21:03:34.372505 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-52d1e53c-2983-4165-89cf-19b514035c33 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] 10.222.0.20 "GET /compute/v2.1/servers/90cfd865-c450-453f-b03d-8c7e897ef805" status: 404 len: 111 microversion: 2.1 time: 0.032126 Jul 05 21:03:34.372505 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 437/852] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 21:03:34 2022] GET /compute/v2.1/servers/90cfd865-c450-453f-b03d-8c7e897ef805 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 05 21:03:34.377184 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-b48cd77b-33b0-4a2c-afbb-3c16f72ca1ff tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Calling method '.version_select at 0x7f57cdebaa60>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 21:03:34.395453 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-b48cd77b-33b0-4a2c-afbb-3c16f72ca1ff tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-479632561" status: 202 len: 0 microversion: 2.1 time: 0.022453 Jul 05 21:03:34.396035 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 416/853] 10.222.0.20 () {58 vars in 1217 bytes} [Tue Jul 5 21:03:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-479632561 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 05 21:03:35.038681 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-c829a1b9-c151-4a6d-97a7-b092bae75e54 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Action: 'create', calling method: .version_select at 0x7f57ce0df040>, body: {"keypair": {"name": "tempest-keypair-1291947984", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHGAOG3A+9UiIrtJVt+kpG+4UtC9J2ap7adEOYnspIkR1z2t+IuumUFYNv7ZwlB21zH2+WNqIPCgz5k0LaYEE3rvCUxO5SN7WxHKZY8KlfbBse5beRhuQ1oml6STFKUHQQ=="}} {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 21:03:35.052731 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.quota [None req-c829a1b9-c151-4a6d-97a7-b092bae75e54 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Getting quotas for project e74557ea7f0f4057b190c0adaaa80ed9. Resources: {'key_pairs'} {{(pid=117628) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 05 21:03:35.056517 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.quota [None req-c829a1b9-c151-4a6d-97a7-b092bae75e54 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Getting quotas for user 0e12538a6dd44bdd963e9850c24c04bc and project e74557ea7f0f4057b190c0adaaa80ed9. Resources: {'key_pairs'} {{(pid=117628) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 05 21:03:35.068745 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR oslo.messaging._drivers.impl_rabbit [None req-c829a1b9-c151-4a6d-97a7-b092bae75e54 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] [8b66166e-fd5a-4758-8fcf-263a28177928] AMQP server on 10.222.0.20:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 05 21:03:36.076306 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO oslo.messaging._drivers.impl_rabbit [None req-c829a1b9-c151-4a6d-97a7-b092bae75e54 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] [8b66166e-fd5a-4758-8fcf-263a28177928] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 42206. Jul 05 21:03:36.090349 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-c829a1b9-c151-4a6d-97a7-b092bae75e54 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 1.055099 Jul 05 21:03:36.090964 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 438/854] 10.222.0.20 () {60 vars in 1158 bytes} [Tue Jul 5 21:03:35 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 1057 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 05 21:03:37.306242 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-fc8b8da4-7c11-408b-beb4-3614d4964f6f tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-463954414", "imageRef": "88e08f49-c01d-4849-a89f-b678588e56f4", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "97c418a5-f615-4ab3-8ff8-ab5b10a93501"}], "security_groups": [{"name": "tempest-securitygroup--857234397"}], "key_name": "tempest-keypair-1291947984", "user_data": "}} {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 21:03:37.406843 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.network.neutron [None req-fc8b8da4-7c11-408b-beb4-3614d4964f6f tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] validate_networks() for [('97c418a5-f615-4ab3-8ff8-ab5b10a93501', None, None, None, None, None)] {{(pid=117627) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 05 21:03:37.778773 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.virt.hardware [None req-fc8b8da4-7c11-408b-beb4-3614d4964f6f tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Flavor limits 0:0:0 {{(pid=117627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 05 21:03:37.779264 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.virt.hardware [None req-fc8b8da4-7c11-408b-beb4-3614d4964f6f tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Image limits 0:0:0 {{(pid=117627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 05 21:03:37.779747 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.virt.hardware [None req-fc8b8da4-7c11-408b-beb4-3614d4964f6f tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Flavor pref 0:0:0 {{(pid=117627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 05 21:03:37.780161 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.virt.hardware [None req-fc8b8da4-7c11-408b-beb4-3614d4964f6f tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Image pref 0:0:0 {{(pid=117627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 05 21:03:37.780575 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.virt.hardware [None req-fc8b8da4-7c11-408b-beb4-3614d4964f6f tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 05 21:03:37.789721 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-fc8b8da4-7c11-408b-beb4-3614d4964f6f tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:03:37.790163 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-fc8b8da4-7c11-408b-beb4-3614d4964f6f tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:03:37.790951 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-fc8b8da4-7c11-408b-beb4-3614d4964f6f tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:03:37.791384 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-fc8b8da4-7c11-408b-beb4-3614d4964f6f tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:03:37.808788 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.quota [None req-fc8b8da4-7c11-408b-beb4-3614d4964f6f tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Getting quotas for project e74557ea7f0f4057b190c0adaaa80ed9. Resources: {'cores', 'ram', 'instances'} {{(pid=117627) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 05 21:03:37.812981 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.quota [None req-fc8b8da4-7c11-408b-beb4-3614d4964f6f tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Getting quotas for user 0e12538a6dd44bdd963e9850c24c04bc and project e74557ea7f0f4057b190c0adaaa80ed9. Resources: {'cores', 'ram', 'instances'} {{(pid=117627) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 05 21:03:37.823787 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-fc8b8da4-7c11-408b-beb4-3614d4964f6f tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Going to run 1 instances... {{(pid=117627) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 05 21:03:37.827123 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-fc8b8da4-7c11-408b-beb4-3614d4964f6f tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] [instance: 0dcf88d1-f7a6-4fbd-a875-93ffadf791a0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='88e08f49-c01d-4849-a89f-b678588e56f4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117627) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 05 21:03:37.873381 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-fc8b8da4-7c11-408b-beb4-3614d4964f6f tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.571305 Jul 05 21:03:37.874093 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 417/855] 10.222.0.20 () {60 vars in 1146 bytes} [Tue Jul 5 21:03:37 2022] POST /compute/v2.1/servers => generated 401 bytes in 573 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 05 21:03:37.884413 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-a2246815-ca8f-4f7e-9748-e0267c5420ca tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 21:03:37.885041 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-a2246815-ca8f-4f7e-9748-e0267c5420ca tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] [instance: 0dcf88d1-f7a6-4fbd-a875-93ffadf791a0] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 21:03:37.938744 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-a2246815-ca8f-4f7e-9748-e0267c5420ca tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e12538a6dd44bdd963e9850c24c04bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e74557ea7f0f4057b190c0adaaa80ed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 21:03:37.945534 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-a2246815-ca8f-4f7e-9748-e0267c5420ca tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] 10.222.0.20 "GET /compute/v2.1/servers/0dcf88d1-f7a6-4fbd-a875-93ffadf791a0" status: 200 len: 1241 microversion: 2.1 time: 0.065448 Jul 05 21:03:37.946099 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 439/856] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 21:03:37 2022] GET /compute/v2.1/servers/0dcf88d1-f7a6-4fbd-a875-93ffadf791a0 => generated 1241 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 21:03:38.961972 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-26218785-601d-45ed-a988-33601fb2f041 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 21:03:38.962578 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-26218785-601d-45ed-a988-33601fb2f041 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] [instance: 0dcf88d1-f7a6-4fbd-a875-93ffadf791a0] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 21:03:38.970450 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-26218785-601d-45ed-a988-33601fb2f041 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:03:38.970883 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-26218785-601d-45ed-a988-33601fb2f041 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:03:38.971862 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-26218785-601d-45ed-a988-33601fb2f041 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:03:38.972292 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-26218785-601d-45ed-a988-33601fb2f041 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:03:39.044149 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-26218785-601d-45ed-a988-33601fb2f041 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e12538a6dd44bdd963e9850c24c04bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e74557ea7f0f4057b190c0adaaa80ed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 21:03:39.051671 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-26218785-601d-45ed-a988-33601fb2f041 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] 10.222.0.20 "GET /compute/v2.1/servers/0dcf88d1-f7a6-4fbd-a875-93ffadf791a0" status: 200 len: 1299 microversion: 2.1 time: 0.093461 Jul 05 21:03:39.052230 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 418/857] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 21:03:38 2022] GET /compute/v2.1/servers/0dcf88d1-f7a6-4fbd-a875-93ffadf791a0 => generated 1299 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 21:03:40.069008 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-065b3742-cae0-4e39-b75e-8deae01b1e50 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 21:03:40.069584 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-065b3742-cae0-4e39-b75e-8deae01b1e50 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] [instance: 0dcf88d1-f7a6-4fbd-a875-93ffadf791a0] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 21:03:40.077423 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-065b3742-cae0-4e39-b75e-8deae01b1e50 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:03:40.077868 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-065b3742-cae0-4e39-b75e-8deae01b1e50 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:03:40.078632 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-065b3742-cae0-4e39-b75e-8deae01b1e50 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:03:40.079229 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-065b3742-cae0-4e39-b75e-8deae01b1e50 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:03:40.272039 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-065b3742-cae0-4e39-b75e-8deae01b1e50 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e12538a6dd44bdd963e9850c24c04bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e74557ea7f0f4057b190c0adaaa80ed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 21:03:40.279601 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-065b3742-cae0-4e39-b75e-8deae01b1e50 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] 10.222.0.20 "GET /compute/v2.1/servers/0dcf88d1-f7a6-4fbd-a875-93ffadf791a0" status: 200 len: 1366 microversion: 2.1 time: 0.214553 Jul 05 21:03:40.280185 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 440/858] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 21:03:40 2022] GET /compute/v2.1/servers/0dcf88d1-f7a6-4fbd-a875-93ffadf791a0 => generated 1366 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 21:03:40.357924 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [req-c6f7cbe5-7093-4e1f-912f-4afe706b1f7b req-57bfc172-a608-449c-a342-90c28229cb99 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0dcf88d1-f7a6-4fbd-a875-93ffadf791a0", "tag": "3051664f-6676-4a9d-87ba-1294ce623d22"}]} {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 21:03:40.367944 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [req-c6f7cbe5-7093-4e1f-912f-4afe706b1f7b req-57bfc172-a608-449c-a342-90c28229cb99 service nova] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:03:40.368398 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [req-c6f7cbe5-7093-4e1f-912f-4afe706b1f7b req-57bfc172-a608-449c-a342-90c28229cb99 service nova] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:03:40.381598 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.compute.server_external_events [req-c6f7cbe5-7093-4e1f-912f-4afe706b1f7b req-57bfc172-a608-449c-a342-90c28229cb99 service nova] Creating event network-changed:3051664f-6676-4a9d-87ba-1294ce623d22 for instance 0dcf88d1-f7a6-4fbd-a875-93ffadf791a0 on hv-cinder-79760 Jul 05 21:03:40.386370 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [req-c6f7cbe5-7093-4e1f-912f-4afe706b1f7b req-57bfc172-a608-449c-a342-90c28229cb99 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035691 Jul 05 21:03:40.388211 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 419/859] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 5 21:03:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 21:03:41.295760 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-4bd8be39-fc57-4c94-bac6-e47056ac6267 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 21:03:41.296366 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-4bd8be39-fc57-4c94-bac6-e47056ac6267 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] [instance: 0dcf88d1-f7a6-4fbd-a875-93ffadf791a0] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 21:03:41.302847 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-4bd8be39-fc57-4c94-bac6-e47056ac6267 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:03:41.303293 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-4bd8be39-fc57-4c94-bac6-e47056ac6267 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:03:41.304038 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-4bd8be39-fc57-4c94-bac6-e47056ac6267 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:03:41.304465 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-4bd8be39-fc57-4c94-bac6-e47056ac6267 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:03:41.616324 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-4bd8be39-fc57-4c94-bac6-e47056ac6267 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e12538a6dd44bdd963e9850c24c04bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e74557ea7f0f4057b190c0adaaa80ed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 21:03:41.624765 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-4bd8be39-fc57-4c94-bac6-e47056ac6267 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] 10.222.0.20 "GET /compute/v2.1/servers/0dcf88d1-f7a6-4fbd-a875-93ffadf791a0" status: 200 len: 1366 microversion: 2.1 time: 0.333040 Jul 05 21:03:41.625360 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 441/860] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 21:03:41 2022] GET /compute/v2.1/servers/0dcf88d1-f7a6-4fbd-a875-93ffadf791a0 => generated 1366 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 21:03:42.642948 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-ee6013cc-4efb-403d-b5c7-ec326d4b3200 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 21:03:42.643637 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-ee6013cc-4efb-403d-b5c7-ec326d4b3200 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] [instance: 0dcf88d1-f7a6-4fbd-a875-93ffadf791a0] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 21:03:42.649777 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-ee6013cc-4efb-403d-b5c7-ec326d4b3200 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:03:42.650219 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-ee6013cc-4efb-403d-b5c7-ec326d4b3200 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:03:42.650963 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-ee6013cc-4efb-403d-b5c7-ec326d4b3200 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:03:42.651392 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-ee6013cc-4efb-403d-b5c7-ec326d4b3200 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:03:42.791747 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-ee6013cc-4efb-403d-b5c7-ec326d4b3200 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e12538a6dd44bdd963e9850c24c04bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e74557ea7f0f4057b190c0adaaa80ed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 21:03:42.799850 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-ee6013cc-4efb-403d-b5c7-ec326d4b3200 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] 10.222.0.20 "GET /compute/v2.1/servers/0dcf88d1-f7a6-4fbd-a875-93ffadf791a0" status: 200 len: 1366 microversion: 2.1 time: 0.161887 Jul 05 21:03:42.800418 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 420/861] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 21:03:42 2022] GET /compute/v2.1/servers/0dcf88d1-f7a6-4fbd-a875-93ffadf791a0 => generated 1366 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 21:03:43.817094 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-4098d2c7-4dec-4a90-a50f-8673fff818ad tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 21:03:43.817704 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-4098d2c7-4dec-4a90-a50f-8673fff818ad tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] [instance: 0dcf88d1-f7a6-4fbd-a875-93ffadf791a0] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 21:03:43.824917 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-4098d2c7-4dec-4a90-a50f-8673fff818ad tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:03:43.825384 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-4098d2c7-4dec-4a90-a50f-8673fff818ad tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:03:43.826142 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-4098d2c7-4dec-4a90-a50f-8673fff818ad tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:03:43.826571 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-4098d2c7-4dec-4a90-a50f-8673fff818ad tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:03:43.954747 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-4098d2c7-4dec-4a90-a50f-8673fff818ad tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e12538a6dd44bdd963e9850c24c04bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e74557ea7f0f4057b190c0adaaa80ed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 21:03:43.962112 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-4098d2c7-4dec-4a90-a50f-8673fff818ad tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] 10.222.0.20 "GET /compute/v2.1/servers/0dcf88d1-f7a6-4fbd-a875-93ffadf791a0" status: 200 len: 1366 microversion: 2.1 time: 0.148994 Jul 05 21:03:43.962656 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 442/862] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 21:03:43 2022] GET /compute/v2.1/servers/0dcf88d1-f7a6-4fbd-a875-93ffadf791a0 => generated 1366 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 21:03:44.946113 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [req-8b7c896a-79a5-48f5-b45a-c21b524c17ae req-de335f91-fa68-42a5-bee2-185e7e45a88a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0dcf88d1-f7a6-4fbd-a875-93ffadf791a0", "name": "network-vif-plugged", "status": "completed", "tag": "3051664f-6676-4a9d-87ba-1294ce623d22"}]} {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 21:03:44.955153 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [req-8b7c896a-79a5-48f5-b45a-c21b524c17ae req-de335f91-fa68-42a5-bee2-185e7e45a88a service nova] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:03:44.955658 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [req-8b7c896a-79a5-48f5-b45a-c21b524c17ae req-de335f91-fa68-42a5-bee2-185e7e45a88a service nova] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:03:44.968330 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.compute.server_external_events [req-8b7c896a-79a5-48f5-b45a-c21b524c17ae req-de335f91-fa68-42a5-bee2-185e7e45a88a service nova] Creating event network-vif-plugged:3051664f-6676-4a9d-87ba-1294ce623d22 for instance 0dcf88d1-f7a6-4fbd-a875-93ffadf791a0 on hv-cinder-79760 Jul 05 21:03:44.973107 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [req-8b7c896a-79a5-48f5-b45a-c21b524c17ae req-de335f91-fa68-42a5-bee2-185e7e45a88a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030846 Jul 05 21:03:44.974145 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 421/863] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 5 21:03:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 21:03:44.979419 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-f50a71fb-70fd-46bd-9e54-1716007b4fc5 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 21:03:44.980640 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-f50a71fb-70fd-46bd-9e54-1716007b4fc5 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] [instance: 0dcf88d1-f7a6-4fbd-a875-93ffadf791a0] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 21:03:44.987253 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-f50a71fb-70fd-46bd-9e54-1716007b4fc5 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:03:44.987708 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-f50a71fb-70fd-46bd-9e54-1716007b4fc5 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:03:44.988512 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-f50a71fb-70fd-46bd-9e54-1716007b4fc5 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:03:44.989291 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-f50a71fb-70fd-46bd-9e54-1716007b4fc5 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:03:45.134421 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-f50a71fb-70fd-46bd-9e54-1716007b4fc5 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e12538a6dd44bdd963e9850c24c04bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e74557ea7f0f4057b190c0adaaa80ed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 21:03:45.143097 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-f50a71fb-70fd-46bd-9e54-1716007b4fc5 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] 10.222.0.20 "GET /compute/v2.1/servers/0dcf88d1-f7a6-4fbd-a875-93ffadf791a0" status: 200 len: 1366 microversion: 2.1 time: 0.167516 Jul 05 21:03:45.143771 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 443/864] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 21:03:44 2022] GET /compute/v2.1/servers/0dcf88d1-f7a6-4fbd-a875-93ffadf791a0 => generated 1366 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 21:03:46.161080 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-aaac4190-9cf2-4003-8aa6-d9484bebb61c tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 21:03:46.161790 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-aaac4190-9cf2-4003-8aa6-d9484bebb61c tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] [instance: 0dcf88d1-f7a6-4fbd-a875-93ffadf791a0] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 21:03:46.168655 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-aaac4190-9cf2-4003-8aa6-d9484bebb61c tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:03:46.169127 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-aaac4190-9cf2-4003-8aa6-d9484bebb61c tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:03:46.169873 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-aaac4190-9cf2-4003-8aa6-d9484bebb61c tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:03:46.170298 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-aaac4190-9cf2-4003-8aa6-d9484bebb61c tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:03:46.312496 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-aaac4190-9cf2-4003-8aa6-d9484bebb61c tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e12538a6dd44bdd963e9850c24c04bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e74557ea7f0f4057b190c0adaaa80ed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 21:03:46.319956 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-aaac4190-9cf2-4003-8aa6-d9484bebb61c tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] 10.222.0.20 "GET /compute/v2.1/servers/0dcf88d1-f7a6-4fbd-a875-93ffadf791a0" status: 200 len: 1366 microversion: 2.1 time: 0.163597 Jul 05 21:03:46.320518 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 422/865] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 21:03:46 2022] GET /compute/v2.1/servers/0dcf88d1-f7a6-4fbd-a875-93ffadf791a0 => generated 1366 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 21:03:47.337444 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-cfa6cf29-fa82-4714-a9c8-3a1bc39afa74 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 21:03:47.338056 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-cfa6cf29-fa82-4714-a9c8-3a1bc39afa74 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] [instance: 0dcf88d1-f7a6-4fbd-a875-93ffadf791a0] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 21:03:47.344785 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-cfa6cf29-fa82-4714-a9c8-3a1bc39afa74 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:03:47.345270 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-cfa6cf29-fa82-4714-a9c8-3a1bc39afa74 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:03:47.346036 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-cfa6cf29-fa82-4714-a9c8-3a1bc39afa74 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:03:47.346472 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-cfa6cf29-fa82-4714-a9c8-3a1bc39afa74 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:03:47.476289 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-cfa6cf29-fa82-4714-a9c8-3a1bc39afa74 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e12538a6dd44bdd963e9850c24c04bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e74557ea7f0f4057b190c0adaaa80ed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 21:03:47.484363 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-cfa6cf29-fa82-4714-a9c8-3a1bc39afa74 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] 10.222.0.20 "GET /compute/v2.1/servers/0dcf88d1-f7a6-4fbd-a875-93ffadf791a0" status: 200 len: 1556 microversion: 2.1 time: 0.150697 Jul 05 21:03:47.484905 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 444/866] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 21:03:47 2022] GET /compute/v2.1/servers/0dcf88d1-f7a6-4fbd-a875-93ffadf791a0 => generated 1556 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 21:03:47.500161 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-a71154fe-2004-43b9-b336-c7a1a33360c3 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 21:03:47.500639 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-a71154fe-2004-43b9-b336-c7a1a33360c3 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] [instance: 0dcf88d1-f7a6-4fbd-a875-93ffadf791a0] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 21:03:47.507076 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-a71154fe-2004-43b9-b336-c7a1a33360c3 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:03:47.507454 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-a71154fe-2004-43b9-b336-c7a1a33360c3 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:03:47.508227 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-a71154fe-2004-43b9-b336-c7a1a33360c3 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:03:47.508653 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-a71154fe-2004-43b9-b336-c7a1a33360c3 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:03:47.586432 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-a71154fe-2004-43b9-b336-c7a1a33360c3 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] 10.222.0.20 "GET /compute/v2.1/servers/0dcf88d1-f7a6-4fbd-a875-93ffadf791a0/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.089964 Jul 05 21:03:47.587039 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 423/867] 10.222.0.20 () {58 vars in 1274 bytes} [Tue Jul 5 21:03:47 2022] GET /compute/v2.1/servers/0dcf88d1-f7a6-4fbd-a875-93ffadf791a0/os-interface => generated 284 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 21:03:48.763141 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [req-79710d39-5b07-4118-8c67-f3d20a494b87 req-a6113e80-1272-4982-b841-0936ef93ba96 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0dcf88d1-f7a6-4fbd-a875-93ffadf791a0", "tag": "3051664f-6676-4a9d-87ba-1294ce623d22"}]} {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 21:03:48.767039 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG dbcounter [-] [117628] Writing DB stats nova_cell0:SELECT=6 {{(pid=117628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:03:48.773601 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [req-79710d39-5b07-4118-8c67-f3d20a494b87 req-a6113e80-1272-4982-b841-0936ef93ba96 service nova] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:03:48.774243 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [req-79710d39-5b07-4118-8c67-f3d20a494b87 req-a6113e80-1272-4982-b841-0936ef93ba96 service nova] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:03:48.787053 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.compute.server_external_events [req-79710d39-5b07-4118-8c67-f3d20a494b87 req-a6113e80-1272-4982-b841-0936ef93ba96 service nova] Creating event network-changed:3051664f-6676-4a9d-87ba-1294ce623d22 for instance 0dcf88d1-f7a6-4fbd-a875-93ffadf791a0 on hv-cinder-79760 Jul 05 21:03:48.794496 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [req-79710d39-5b07-4118-8c67-f3d20a494b87 req-a6113e80-1272-4982-b841-0936ef93ba96 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033047 Jul 05 21:03:48.794496 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 445/868] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 5 21:03:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 21:04:20.698879 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG dbcounter [-] [117627] Writing DB stats nova_cell0:SELECT=2 {{(pid=117627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:04:20.700551 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG dbcounter [-] [117627] Writing DB stats nova_cell0:SELECT=6 {{(pid=117627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:04:20.702482 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG dbcounter [-] [117627] Writing DB stats nova_api:SELECT=59,nova_api:UPDATE=2,nova_api:DELETE=2,nova_api:INSERT=3 {{(pid=117627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:04:20.702622 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG dbcounter [-] [117628] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=1 {{(pid=117628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:04:20.703119 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG dbcounter [-] [117627] Writing DB stats nova_cell1:SELECT=82,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:04:20.703704 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG dbcounter [-] [117628] Writing DB stats nova_cell1:SELECT=81,nova_cell1:INSERT=1 {{(pid=117628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:04:20.707890 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [req-f1f58105-1487-4ee6-a9f8-75f956d92c0b req-8ef965cd-9d02-468e-925a-67de9878d1c2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "31d561da-981c-4461-ac77-28d08ec752ad", "tag": "c770b7ee-822c-4aa2-aba0-ca803c58e3b4"}]} {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 21:04:20.708319 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-9ed579e9-9936-4c31-b066-33d0ee8d09e4 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 21:04:20.709054 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-9ed579e9-9936-4c31-b066-33d0ee8d09e4 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] [instance: 31d561da-981c-4461-ac77-28d08ec752ad] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 21:04:20.718956 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [req-f1f58105-1487-4ee6-a9f8-75f956d92c0b req-8ef965cd-9d02-468e-925a-67de9878d1c2 service nova] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:04:20.719409 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [req-f1f58105-1487-4ee6-a9f8-75f956d92c0b req-8ef965cd-9d02-468e-925a-67de9878d1c2 service nova] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:04:20.731436 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.compute.server_external_events [req-f1f58105-1487-4ee6-a9f8-75f956d92c0b req-8ef965cd-9d02-468e-925a-67de9878d1c2 service nova] Creating event network-changed:c770b7ee-822c-4aa2-aba0-ca803c58e3b4 for instance 31d561da-981c-4461-ac77-28d08ec752ad on hv-cinder-79760 Jul 05 21:04:20.733534 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-9ed579e9-9936-4c31-b066-33d0ee8d09e4 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:04:20.734029 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-9ed579e9-9936-4c31-b066-33d0ee8d09e4 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:04:20.735977 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-9ed579e9-9936-4c31-b066-33d0ee8d09e4 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:04:20.736434 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-9ed579e9-9936-4c31-b066-33d0ee8d09e4 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:04:20.736568 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [req-f1f58105-1487-4ee6-a9f8-75f956d92c0b req-8ef965cd-9d02-468e-925a-67de9878d1c2 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035347 Jul 05 21:04:20.737283 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 446/869] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 5 21:04:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 05 21:04:20.768975 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-9ed579e9-9936-4c31-b066-33d0ee8d09e4 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] [instance: 31d561da-981c-4461-ac77-28d08ec752ad] Going to try to terminate instance {{(pid=117627) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 05 21:04:20.867733 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-9ed579e9-9936-4c31-b066-33d0ee8d09e4 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] 10.222.0.20 "DELETE /compute/v2.1/servers/31d561da-981c-4461-ac77-28d08ec752ad" status: 204 len: 0 microversion: 2.1 time: 0.169381 Jul 05 21:04:20.869120 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 424/870] 10.222.0.20 () {58 vars in 1238 bytes} [Tue Jul 5 21:04:20 2022] DELETE /compute/v2.1/servers/31d561da-981c-4461-ac77-28d08ec752ad => generated 0 bytes in 172 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 05 21:04:20.878907 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-88cb0b8e-fa14-44c0-a23a-f7b31d9048f0 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 21:04:20.879896 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-88cb0b8e-fa14-44c0-a23a-f7b31d9048f0 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] [instance: 31d561da-981c-4461-ac77-28d08ec752ad] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 21:04:20.887287 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-88cb0b8e-fa14-44c0-a23a-f7b31d9048f0 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:04:20.887850 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-88cb0b8e-fa14-44c0-a23a-f7b31d9048f0 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:04:20.889313 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-88cb0b8e-fa14-44c0-a23a-f7b31d9048f0 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:04:20.889754 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-88cb0b8e-fa14-44c0-a23a-f7b31d9048f0 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:04:21.151434 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-88cb0b8e-fa14-44c0-a23a-f7b31d9048f0 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '261feb03a8ff459b8874232bec05034f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9a3d56f8b84eb2a057425afbf79079', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 21:04:21.159565 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-88cb0b8e-fa14-44c0-a23a-f7b31d9048f0 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] 10.222.0.20 "GET /compute/v2.1/servers/31d561da-981c-4461-ac77-28d08ec752ad" status: 200 len: 1575 microversion: 2.1 time: 0.285429 Jul 05 21:04:21.160231 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 447/871] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 21:04:20 2022] GET /compute/v2.1/servers/31d561da-981c-4461-ac77-28d08ec752ad => generated 1575 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 21:04:22.178402 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-e2066473-228a-4f6e-afe3-c310f2cfe809 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 21:04:22.179124 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-e2066473-228a-4f6e-afe3-c310f2cfe809 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] [instance: 31d561da-981c-4461-ac77-28d08ec752ad] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 21:04:22.186126 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-e2066473-228a-4f6e-afe3-c310f2cfe809 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:04:22.186565 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-e2066473-228a-4f6e-afe3-c310f2cfe809 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:04:22.187314 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-e2066473-228a-4f6e-afe3-c310f2cfe809 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:04:22.187747 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-e2066473-228a-4f6e-afe3-c310f2cfe809 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:04:22.385434 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-e2066473-228a-4f6e-afe3-c310f2cfe809 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '261feb03a8ff459b8874232bec05034f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9a3d56f8b84eb2a057425afbf79079', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 21:04:22.396863 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-e2066473-228a-4f6e-afe3-c310f2cfe809 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] 10.222.0.20 "GET /compute/v2.1/servers/31d561da-981c-4461-ac77-28d08ec752ad" status: 200 len: 1575 microversion: 2.1 time: 0.222263 Jul 05 21:04:22.397988 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 425/872] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 21:04:22 2022] GET /compute/v2.1/servers/31d561da-981c-4461-ac77-28d08ec752ad => generated 1575 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 21:04:23.360339 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [req-10853788-c736-4925-b9e6-4903f4a50d00 req-1bf5cc51-5223-4128-9805-63289113bf88 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31d561da-981c-4461-ac77-28d08ec752ad", "name": "network-vif-deleted", "tag": "c770b7ee-822c-4aa2-aba0-ca803c58e3b4"}]} {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 21:04:23.371236 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [req-10853788-c736-4925-b9e6-4903f4a50d00 req-1bf5cc51-5223-4128-9805-63289113bf88 service nova] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:04:23.371682 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [req-10853788-c736-4925-b9e6-4903f4a50d00 req-1bf5cc51-5223-4128-9805-63289113bf88 service nova] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:04:23.386441 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.compute.server_external_events [req-10853788-c736-4925-b9e6-4903f4a50d00 req-1bf5cc51-5223-4128-9805-63289113bf88 service nova] Creating event network-vif-deleted:c770b7ee-822c-4aa2-aba0-ca803c58e3b4 for instance 31d561da-981c-4461-ac77-28d08ec752ad on hv-cinder-79760 Jul 05 21:04:23.391364 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [req-10853788-c736-4925-b9e6-4903f4a50d00 req-1bf5cc51-5223-4128-9805-63289113bf88 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034693 Jul 05 21:04:23.391953 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 448/873] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 5 21:04:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 21:04:23.414271 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-d938af79-b892-4756-985b-f96d0f84e789 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 21:04:23.414871 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-d938af79-b892-4756-985b-f96d0f84e789 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] [instance: 31d561da-981c-4461-ac77-28d08ec752ad] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 21:04:23.422128 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-d938af79-b892-4756-985b-f96d0f84e789 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:04:23.422582 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-d938af79-b892-4756-985b-f96d0f84e789 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:04:23.423416 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-d938af79-b892-4756-985b-f96d0f84e789 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:04:23.423892 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-d938af79-b892-4756-985b-f96d0f84e789 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:04:23.488374 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-d938af79-b892-4756-985b-f96d0f84e789 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '261feb03a8ff459b8874232bec05034f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9a3d56f8b84eb2a057425afbf79079', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 21:04:23.496508 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-d938af79-b892-4756-985b-f96d0f84e789 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] 10.222.0.20 "GET /compute/v2.1/servers/31d561da-981c-4461-ac77-28d08ec752ad" status: 200 len: 1224 microversion: 2.1 time: 0.085980 Jul 05 21:04:23.497094 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 426/874] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 21:04:23 2022] GET /compute/v2.1/servers/31d561da-981c-4461-ac77-28d08ec752ad => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 21:04:23.976395 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-1462f975-21f5-4618-97b5-33e9af0528a4 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 21:04:23.976957 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-1462f975-21f5-4618-97b5-33e9af0528a4 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] [instance: 0dcf88d1-f7a6-4fbd-a875-93ffadf791a0] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 21:04:23.983619 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-1462f975-21f5-4618-97b5-33e9af0528a4 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:04:23.984074 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-1462f975-21f5-4618-97b5-33e9af0528a4 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:04:23.984831 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-1462f975-21f5-4618-97b5-33e9af0528a4 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:04:23.985317 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-1462f975-21f5-4618-97b5-33e9af0528a4 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:04:24.011453 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-1462f975-21f5-4618-97b5-33e9af0528a4 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] 10.222.0.20 "GET /compute/v2.1/servers/0dcf88d1-f7a6-4fbd-a875-93ffadf791a0/ips" status: 200 len: 150 microversion: 2.1 time: 0.039383 Jul 05 21:04:24.012026 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 449/875] 10.222.0.20 () {58 vars in 1247 bytes} [Tue Jul 5 21:04:23 2022] GET /compute/v2.1/servers/0dcf88d1-f7a6-4fbd-a875-93ffadf791a0/ips => generated 150 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 21:04:24.514245 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-ed3df04d-3893-4570-9390-730df7589e51 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 21:04:24.514798 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-ed3df04d-3893-4570-9390-730df7589e51 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] [instance: 31d561da-981c-4461-ac77-28d08ec752ad] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 21:04:24.521198 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-ed3df04d-3893-4570-9390-730df7589e51 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:04:24.521636 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-ed3df04d-3893-4570-9390-730df7589e51 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:04:24.522380 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-ed3df04d-3893-4570-9390-730df7589e51 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:04:24.522808 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-ed3df04d-3893-4570-9390-730df7589e51 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:04:24.537314 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.wsgi [None req-ed3df04d-3893-4570-9390-730df7589e51 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] HTTP exception thrown: Instance 31d561da-981c-4461-ac77-28d08ec752ad could not be found. Jul 05 21:04:24.539294 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-ed3df04d-3893-4570-9390-730df7589e51 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Request method failure captured: Jul 05 21:04:24.539294 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: request: GET /compute/v2.1/servers/31d561da-981c-4461-ac77-28d08ec752ad HTTP/1.1 Jul 05 21:04:24.539294 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: Accept: application/json Jul 05 21:04:24.539294 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: Accept-Encoding: identity Jul 05 21:04:24.539294 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: Connection: close Jul 05 21:04:24.539294 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: Content-Length: 0 Jul 05 21:04:24.539294 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: Content-Type: application/json Jul 05 21:04:24.539294 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: Host: 10.222.0.20 Jul 05 21:04:24.539294 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: Openstack-System-Scope: None Jul 05 21:04:24.539294 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: User-Agent: python-urllib3/1.26.9 Jul 05 21:04:24.539294 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Auth-Token: gAAAAABixKV-GcDC4lUNiJdOqEVVMAbZnkn9E9HC7T9UddyKTAtPpXm0wmmCXq37cCErruEoTYPrxR2enkx0RyOZqfGtr6EG-anGncOUaEEqbpXW3Rg6XJ-ohCrIXyT7Tt7TbgrLJi1wtWjTZD0cChjlb5fxi6qKGTwb9N8HmmJDYhtyE3zq-bo Jul 05 21:04:24.539294 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Domain-Id: None Jul 05 21:04:24.539294 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Domain-Name: None Jul 05 21:04:24.539294 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Identity-Status: Confirmed Jul 05 21:04:24.539294 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Is-Admin-Project: True Jul 05 21:04:24.539294 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Project-Domain-Id: default Jul 05 21:04:24.539294 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Project-Domain-Name: Default Jul 05 21:04:24.539294 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Project-Id: 6c9a3d56f8b84eb2a057425afbf79079 Jul 05 21:04:24.539294 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Project-Name: tempest-TestVolumeBootPattern-1281668618 Jul 05 21:04:24.539294 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Role: member,reader Jul 05 21:04:24.539294 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Roles: member,reader Jul 05 21:04:24.541316 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6c9a3d56f8b84eb2a057425afbf79079"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6c9a3d56f8b84eb2a057425afbf79079"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6c9a3d56f8b84eb2a057425afbf79079"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6c9a3d56f8b84eb2a057425afbf79079"}]}] Jul 05 21:04:24.541316 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Tenant: tempest-TestVolumeBootPattern-1281668618 Jul 05 21:04:24.541316 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Tenant-Id: 6c9a3d56f8b84eb2a057425afbf79079 Jul 05 21:04:24.541316 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Tenant-Name: tempest-TestVolumeBootPattern-1281668618 Jul 05 21:04:24.541316 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-User: tempest-TestVolumeBootPattern-1281668618-project Jul 05 21:04:24.541316 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-User-Domain-Id: default Jul 05 21:04:24.541316 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-User-Domain-Name: Default Jul 05 21:04:24.541316 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-User-Id: 261feb03a8ff459b8874232bec05034f Jul 05 21:04:24.541316 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-User-Name: tempest-TestVolumeBootPattern-1281668618-project Jul 05 21:04:24.541316 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: method: > Jul 05 21:04:24.541316 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: exception: Instance 31d561da-981c-4461-ac77-28d08ec752ad could not be found. Jul 05 21:04:24.541316 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: action_args: {'id': '31d561da-981c-4461-ac77-28d08ec752ad'} Jul 05 21:04:24.542328 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 05 21:04:24.542328 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 21:04:24.542328 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 05 21:04:24.542328 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 05 21:04:24.542328 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 05 21:04:24.542328 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 05 21:04:24.542328 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 05 21:04:24.542328 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 05 21:04:24.542328 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 05 21:04:24.542328 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 05 21:04:24.542328 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 31d561da-981c-4461-ac77-28d08ec752ad could not be found. Jul 05 21:04:24.542328 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi Jul 05 21:04:24.542328 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 21:04:24.542328 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi Jul 05 21:04:24.542328 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 21:04:24.542328 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 21:04:24.542328 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 21:04:24.542328 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 05 21:04:24.542328 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 05 21:04:24.542328 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 05 21:04:24.543937 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 05 21:04:24.543937 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 05 21:04:24.543937 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 05 21:04:24.543937 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 05 21:04:24.543937 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 05 21:04:24.543937 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 05 21:04:24.543937 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 05 21:04:24.543937 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 31d561da-981c-4461-ac77-28d08ec752ad could not be found. Jul 05 21:04:24.543937 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi Jul 05 21:04:24.543937 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 21:04:24.543937 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi Jul 05 21:04:24.543937 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 21:04:24.543937 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 21:04:24.543937 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 21:04:24.543937 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 05 21:04:24.543937 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 05 21:04:24.543937 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 31d561da-981c-4461-ac77-28d08ec752ad could not be found. Jul 05 21:04:24.543937 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi Jul 05 21:04:24.545416 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-ed3df04d-3893-4570-9390-730df7589e51 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Returning 404 to user: Instance 31d561da-981c-4461-ac77-28d08ec752ad could not be found. {{(pid=117627) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 05 21:04:24.545416 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-ed3df04d-3893-4570-9390-730df7589e51 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] 10.222.0.20 "GET /compute/v2.1/servers/31d561da-981c-4461-ac77-28d08ec752ad" status: 404 len: 111 microversion: 2.1 time: 0.031541 Jul 05 21:04:24.545416 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 427/876] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 21:04:24 2022] GET /compute/v2.1/servers/31d561da-981c-4461-ac77-28d08ec752ad => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 05 21:04:25.333069 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-5445d76d-fd6c-4a38-bceb-b52148447a1b tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f045bb81-5cb2-4eaf-9f56-610dc8cbb25e"}} {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 21:04:25.334121 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-5445d76d-fd6c-4a38-bceb-b52148447a1b tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] [instance: 0dcf88d1-f7a6-4fbd-a875-93ffadf791a0] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 21:04:25.341254 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-5445d76d-fd6c-4a38-bceb-b52148447a1b tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:04:25.341699 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-5445d76d-fd6c-4a38-bceb-b52148447a1b tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:04:25.342448 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-5445d76d-fd6c-4a38-bceb-b52148447a1b tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:04:25.342880 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-5445d76d-fd6c-4a38-bceb-b52148447a1b tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:04:25.627150 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-5445d76d-fd6c-4a38-bceb-b52148447a1b tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] 10.222.0.20 "POST /compute/v2.1/servers/0dcf88d1-f7a6-4fbd-a875-93ffadf791a0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.297804 Jul 05 21:04:25.627737 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 450/877] 10.222.0.20 () {60 vars in 1322 bytes} [Tue Jul 5 21:04:25 2022] POST /compute/v2.1/servers/0dcf88d1-f7a6-4fbd-a875-93ffadf791a0/os-volume_attachments => generated 194 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 21:04:27.601515 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-47e196fd-f564-45c7-b012-06c00881c9a0 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 21:04:27.602039 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-47e196fd-f564-45c7-b012-06c00881c9a0 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] [instance: eb4c9422-c2c5-4b9a-a86c-a913dfaeda45] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 21:04:27.606144 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [req-cc520738-d4b5-4fe1-91ae-d81768251d5a req-bdd0d9b6-3112-4749-a2ac-d143df1ff57a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eb4c9422-c2c5-4b9a-a86c-a913dfaeda45", "tag": "eae5be01-7130-4460-95d2-13ad37982542"}]} {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 21:04:27.614980 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [req-cc520738-d4b5-4fe1-91ae-d81768251d5a req-bdd0d9b6-3112-4749-a2ac-d143df1ff57a service nova] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:04:27.615942 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [req-cc520738-d4b5-4fe1-91ae-d81768251d5a req-bdd0d9b6-3112-4749-a2ac-d143df1ff57a service nova] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:04:27.620415 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-47e196fd-f564-45c7-b012-06c00881c9a0 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:04:27.620858 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-47e196fd-f564-45c7-b012-06c00881c9a0 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:04:27.621647 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-47e196fd-f564-45c7-b012-06c00881c9a0 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:04:27.622074 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-47e196fd-f564-45c7-b012-06c00881c9a0 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:04:27.627571 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.compute.server_external_events [req-cc520738-d4b5-4fe1-91ae-d81768251d5a req-bdd0d9b6-3112-4749-a2ac-d143df1ff57a service nova] Creating event network-changed:eae5be01-7130-4460-95d2-13ad37982542 for instance eb4c9422-c2c5-4b9a-a86c-a913dfaeda45 on hv-cinder-79760 Jul 05 21:04:27.632865 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [req-cc520738-d4b5-4fe1-91ae-d81768251d5a req-bdd0d9b6-3112-4749-a2ac-d143df1ff57a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032442 Jul 05 21:04:27.634158 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 451/878] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 5 21:04:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 05 21:04:27.654195 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-47e196fd-f564-45c7-b012-06c00881c9a0 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] [instance: eb4c9422-c2c5-4b9a-a86c-a913dfaeda45] Going to try to terminate instance {{(pid=117627) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 05 21:04:27.738694 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-47e196fd-f564-45c7-b012-06c00881c9a0 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] 10.222.0.20 "DELETE /compute/v2.1/servers/eb4c9422-c2c5-4b9a-a86c-a913dfaeda45" status: 204 len: 0 microversion: 2.1 time: 0.141060 Jul 05 21:04:27.742499 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 428/879] 10.222.0.20 () {58 vars in 1238 bytes} [Tue Jul 5 21:04:27 2022] DELETE /compute/v2.1/servers/eb4c9422-c2c5-4b9a-a86c-a913dfaeda45 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 05 21:04:27.751037 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-33e3fcf9-0e12-4049-a960-8fd7143d8a58 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 21:04:27.752007 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-33e3fcf9-0e12-4049-a960-8fd7143d8a58 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] [instance: eb4c9422-c2c5-4b9a-a86c-a913dfaeda45] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 21:04:27.760482 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-33e3fcf9-0e12-4049-a960-8fd7143d8a58 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:04:27.761394 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-33e3fcf9-0e12-4049-a960-8fd7143d8a58 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:04:27.762431 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-33e3fcf9-0e12-4049-a960-8fd7143d8a58 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:04:27.763106 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-33e3fcf9-0e12-4049-a960-8fd7143d8a58 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:04:27.909867 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-33e3fcf9-0e12-4049-a960-8fd7143d8a58 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '261feb03a8ff459b8874232bec05034f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9a3d56f8b84eb2a057425afbf79079', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 21:04:27.918323 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-33e3fcf9-0e12-4049-a960-8fd7143d8a58 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] 10.222.0.20 "GET /compute/v2.1/servers/eb4c9422-c2c5-4b9a-a86c-a913dfaeda45" status: 200 len: 1577 microversion: 2.1 time: 0.172967 Jul 05 21:04:27.918892 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 452/880] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 21:04:27 2022] GET /compute/v2.1/servers/eb4c9422-c2c5-4b9a-a86c-a913dfaeda45 => generated 1577 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 21:04:28.936093 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-9d01fa2b-363d-4ea1-924e-7c8fd1e2989e tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 21:04:28.936778 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-9d01fa2b-363d-4ea1-924e-7c8fd1e2989e tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] [instance: eb4c9422-c2c5-4b9a-a86c-a913dfaeda45] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 21:04:28.943383 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-9d01fa2b-363d-4ea1-924e-7c8fd1e2989e tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:04:28.943837 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-9d01fa2b-363d-4ea1-924e-7c8fd1e2989e tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:04:28.944630 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-9d01fa2b-363d-4ea1-924e-7c8fd1e2989e tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:04:28.945143 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-9d01fa2b-363d-4ea1-924e-7c8fd1e2989e tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:04:29.382397 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-9d01fa2b-363d-4ea1-924e-7c8fd1e2989e tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '261feb03a8ff459b8874232bec05034f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9a3d56f8b84eb2a057425afbf79079', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 21:04:29.391693 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-9d01fa2b-363d-4ea1-924e-7c8fd1e2989e tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] 10.222.0.20 "GET /compute/v2.1/servers/eb4c9422-c2c5-4b9a-a86c-a913dfaeda45" status: 200 len: 1458 microversion: 2.1 time: 0.459720 Jul 05 21:04:29.392505 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 429/881] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 21:04:28 2022] GET /compute/v2.1/servers/eb4c9422-c2c5-4b9a-a86c-a913dfaeda45 => generated 1458 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 21:04:29.807714 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [req-80f46281-a27d-4520-92ee-2b59283738a8 req-3187fbea-3984-4e6d-b797-f79f76351e2d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb4c9422-c2c5-4b9a-a86c-a913dfaeda45", "name": "network-vif-deleted", "tag": "eae5be01-7130-4460-95d2-13ad37982542"}]} {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 21:04:29.816297 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [req-80f46281-a27d-4520-92ee-2b59283738a8 req-3187fbea-3984-4e6d-b797-f79f76351e2d service nova] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:04:29.816740 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [req-80f46281-a27d-4520-92ee-2b59283738a8 req-3187fbea-3984-4e6d-b797-f79f76351e2d service nova] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:04:29.829109 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.compute.server_external_events [req-80f46281-a27d-4520-92ee-2b59283738a8 req-3187fbea-3984-4e6d-b797-f79f76351e2d service nova] Creating event network-vif-deleted:eae5be01-7130-4460-95d2-13ad37982542 for instance eb4c9422-c2c5-4b9a-a86c-a913dfaeda45 on hv-cinder-79760 Jul 05 21:04:29.837729 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [req-80f46281-a27d-4520-92ee-2b59283738a8 req-3187fbea-3984-4e6d-b797-f79f76351e2d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033400 Jul 05 21:04:29.838800 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 453/882] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 5 21:04:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 21:04:30.409286 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-2e83f0b1-798f-46fc-8794-78dd8faef73e tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 21:04:30.409830 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-2e83f0b1-798f-46fc-8794-78dd8faef73e tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] [instance: eb4c9422-c2c5-4b9a-a86c-a913dfaeda45] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 21:04:30.416277 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-2e83f0b1-798f-46fc-8794-78dd8faef73e tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:04:30.416718 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-2e83f0b1-798f-46fc-8794-78dd8faef73e tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:04:30.417539 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-2e83f0b1-798f-46fc-8794-78dd8faef73e tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:04:30.417929 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-2e83f0b1-798f-46fc-8794-78dd8faef73e tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:04:30.449086 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-2e83f0b1-798f-46fc-8794-78dd8faef73e tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:04:30.449533 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-2e83f0b1-798f-46fc-8794-78dd8faef73e tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:04:30.449975 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.objects.instance [None req-2e83f0b1-798f-46fc-8794-78dd8faef73e tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lazy-loading 'fault' on Instance uuid eb4c9422-c2c5-4b9a-a86c-a913dfaeda45 {{(pid=117627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 05 21:04:30.491731 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-2e83f0b1-798f-46fc-8794-78dd8faef73e tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '261feb03a8ff459b8874232bec05034f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9a3d56f8b84eb2a057425afbf79079', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 21:04:30.499920 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-2e83f0b1-798f-46fc-8794-78dd8faef73e tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] 10.222.0.20 "GET /compute/v2.1/servers/eb4c9422-c2c5-4b9a-a86c-a913dfaeda45" status: 200 len: 1229 microversion: 2.1 time: 0.094580 Jul 05 21:04:30.500491 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 430/883] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 21:04:30 2022] GET /compute/v2.1/servers/eb4c9422-c2c5-4b9a-a86c-a913dfaeda45 => generated 1229 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 21:04:31.519191 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-d1ef0142-67bc-4c4e-b241-23364a3f5d50 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 21:04:31.519829 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-d1ef0142-67bc-4c4e-b241-23364a3f5d50 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] [instance: eb4c9422-c2c5-4b9a-a86c-a913dfaeda45] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 21:04:31.526616 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-d1ef0142-67bc-4c4e-b241-23364a3f5d50 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:04:31.527059 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-d1ef0142-67bc-4c4e-b241-23364a3f5d50 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:04:31.527817 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-d1ef0142-67bc-4c4e-b241-23364a3f5d50 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:04:31.528250 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-d1ef0142-67bc-4c4e-b241-23364a3f5d50 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:04:31.542811 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.wsgi [None req-d1ef0142-67bc-4c4e-b241-23364a3f5d50 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] HTTP exception thrown: Instance eb4c9422-c2c5-4b9a-a86c-a913dfaeda45 could not be found. Jul 05 21:04:31.544997 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-d1ef0142-67bc-4c4e-b241-23364a3f5d50 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Request method failure captured: Jul 05 21:04:31.544997 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: request: GET /compute/v2.1/servers/eb4c9422-c2c5-4b9a-a86c-a913dfaeda45 HTTP/1.1 Jul 05 21:04:31.544997 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: Accept: application/json Jul 05 21:04:31.544997 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: Accept-Encoding: identity Jul 05 21:04:31.544997 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: Connection: close Jul 05 21:04:31.544997 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: Content-Length: 0 Jul 05 21:04:31.544997 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: Content-Type: application/json Jul 05 21:04:31.544997 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: Host: 10.222.0.20 Jul 05 21:04:31.544997 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: Openstack-System-Scope: None Jul 05 21:04:31.544997 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: User-Agent: python-urllib3/1.26.9 Jul 05 21:04:31.544997 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Auth-Token: gAAAAABixKV-GcDC4lUNiJdOqEVVMAbZnkn9E9HC7T9UddyKTAtPpXm0wmmCXq37cCErruEoTYPrxR2enkx0RyOZqfGtr6EG-anGncOUaEEqbpXW3Rg6XJ-ohCrIXyT7Tt7TbgrLJi1wtWjTZD0cChjlb5fxi6qKGTwb9N8HmmJDYhtyE3zq-bo Jul 05 21:04:31.544997 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Domain-Id: None Jul 05 21:04:31.544997 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Domain-Name: None Jul 05 21:04:31.544997 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Identity-Status: Confirmed Jul 05 21:04:31.544997 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Is-Admin-Project: True Jul 05 21:04:31.544997 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Project-Domain-Id: default Jul 05 21:04:31.544997 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Project-Domain-Name: Default Jul 05 21:04:31.544997 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Project-Id: 6c9a3d56f8b84eb2a057425afbf79079 Jul 05 21:04:31.544997 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Project-Name: tempest-TestVolumeBootPattern-1281668618 Jul 05 21:04:31.544997 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Role: member,reader Jul 05 21:04:31.544997 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Roles: member,reader Jul 05 21:04:31.546758 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6c9a3d56f8b84eb2a057425afbf79079"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6c9a3d56f8b84eb2a057425afbf79079"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6c9a3d56f8b84eb2a057425afbf79079"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6c9a3d56f8b84eb2a057425afbf79079"}]}] Jul 05 21:04:31.546758 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Tenant: tempest-TestVolumeBootPattern-1281668618 Jul 05 21:04:31.546758 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Tenant-Id: 6c9a3d56f8b84eb2a057425afbf79079 Jul 05 21:04:31.546758 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Tenant-Name: tempest-TestVolumeBootPattern-1281668618 Jul 05 21:04:31.546758 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-User: tempest-TestVolumeBootPattern-1281668618-project Jul 05 21:04:31.546758 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-User-Domain-Id: default Jul 05 21:04:31.546758 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-User-Domain-Name: Default Jul 05 21:04:31.546758 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-User-Id: 261feb03a8ff459b8874232bec05034f Jul 05 21:04:31.546758 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-User-Name: tempest-TestVolumeBootPattern-1281668618-project Jul 05 21:04:31.546758 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: method: > Jul 05 21:04:31.546758 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: exception: Instance eb4c9422-c2c5-4b9a-a86c-a913dfaeda45 could not be found. Jul 05 21:04:31.546758 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: action_args: {'id': 'eb4c9422-c2c5-4b9a-a86c-a913dfaeda45'} Jul 05 21:04:31.547859 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 05 21:04:31.547859 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 21:04:31.547859 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 05 21:04:31.547859 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 05 21:04:31.547859 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 05 21:04:31.547859 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 05 21:04:31.547859 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 05 21:04:31.547859 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 05 21:04:31.547859 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 05 21:04:31.547859 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 05 21:04:31.547859 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eb4c9422-c2c5-4b9a-a86c-a913dfaeda45 could not be found. Jul 05 21:04:31.547859 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi Jul 05 21:04:31.547859 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 21:04:31.547859 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi Jul 05 21:04:31.547859 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 21:04:31.547859 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 21:04:31.547859 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 21:04:31.547859 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 05 21:04:31.547859 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 05 21:04:31.547859 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 05 21:04:31.549610 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 05 21:04:31.549610 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 05 21:04:31.549610 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 05 21:04:31.549610 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 05 21:04:31.549610 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 05 21:04:31.549610 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 05 21:04:31.549610 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 05 21:04:31.549610 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eb4c9422-c2c5-4b9a-a86c-a913dfaeda45 could not be found. Jul 05 21:04:31.549610 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi Jul 05 21:04:31.549610 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 21:04:31.549610 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi Jul 05 21:04:31.549610 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 21:04:31.549610 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 21:04:31.549610 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 21:04:31.549610 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 05 21:04:31.549610 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 05 21:04:31.549610 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eb4c9422-c2c5-4b9a-a86c-a913dfaeda45 could not be found. Jul 05 21:04:31.549610 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi Jul 05 21:04:31.551142 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-d1ef0142-67bc-4c4e-b241-23364a3f5d50 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Returning 404 to user: Instance eb4c9422-c2c5-4b9a-a86c-a913dfaeda45 could not be found. {{(pid=117628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 05 21:04:31.551142 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-d1ef0142-67bc-4c4e-b241-23364a3f5d50 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] 10.222.0.20 "GET /compute/v2.1/servers/eb4c9422-c2c5-4b9a-a86c-a913dfaeda45" status: 404 len: 111 microversion: 2.1 time: 0.031898 Jul 05 21:04:31.551142 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 454/884] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 21:04:31 2022] GET /compute/v2.1/servers/eb4c9422-c2c5-4b9a-a86c-a913dfaeda45 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 05 21:04:31.984441 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-fff1ad6b-c195-4704-a75b-10b1c315b683 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 21:04:31.984952 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-fff1ad6b-c195-4704-a75b-10b1c315b683 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] [instance: 843b93d3-5217-4c0f-b8a9-a335f24c615a] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 21:04:31.992749 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-fff1ad6b-c195-4704-a75b-10b1c315b683 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:04:31.993288 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-fff1ad6b-c195-4704-a75b-10b1c315b683 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:04:31.994235 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-fff1ad6b-c195-4704-a75b-10b1c315b683 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:04:31.994677 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-fff1ad6b-c195-4704-a75b-10b1c315b683 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:04:32.010580 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.wsgi [None req-fff1ad6b-c195-4704-a75b-10b1c315b683 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] HTTP exception thrown: Instance 843b93d3-5217-4c0f-b8a9-a335f24c615a could not be found. Jul 05 21:04:32.012258 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-fff1ad6b-c195-4704-a75b-10b1c315b683 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Request method failure captured: Jul 05 21:04:32.012258 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: request: DELETE /compute/v2.1/servers/843b93d3-5217-4c0f-b8a9-a335f24c615a HTTP/1.1 Jul 05 21:04:32.012258 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: Accept: application/json Jul 05 21:04:32.012258 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: Accept-Encoding: identity Jul 05 21:04:32.012258 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: Connection: close Jul 05 21:04:32.012258 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: Content-Length: 0 Jul 05 21:04:32.012258 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: Content-Type: application/json Jul 05 21:04:32.012258 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: Host: 10.222.0.20 Jul 05 21:04:32.012258 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: Openstack-System-Scope: None Jul 05 21:04:32.012258 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: User-Agent: python-urllib3/1.26.9 Jul 05 21:04:32.012258 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Auth-Token: gAAAAABixKV-GcDC4lUNiJdOqEVVMAbZnkn9E9HC7T9UddyKTAtPpXm0wmmCXq37cCErruEoTYPrxR2enkx0RyOZqfGtr6EG-anGncOUaEEqbpXW3Rg6XJ-ohCrIXyT7Tt7TbgrLJi1wtWjTZD0cChjlb5fxi6qKGTwb9N8HmmJDYhtyE3zq-bo Jul 05 21:04:32.012258 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Domain-Id: None Jul 05 21:04:32.012258 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Domain-Name: None Jul 05 21:04:32.012258 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Identity-Status: Confirmed Jul 05 21:04:32.012258 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Is-Admin-Project: True Jul 05 21:04:32.012258 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Project-Domain-Id: default Jul 05 21:04:32.012258 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Project-Domain-Name: Default Jul 05 21:04:32.012258 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Project-Id: 6c9a3d56f8b84eb2a057425afbf79079 Jul 05 21:04:32.012258 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Project-Name: tempest-TestVolumeBootPattern-1281668618 Jul 05 21:04:32.012258 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Role: member,reader Jul 05 21:04:32.012258 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Roles: member,reader Jul 05 21:04:32.014208 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6c9a3d56f8b84eb2a057425afbf79079"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6c9a3d56f8b84eb2a057425afbf79079"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6c9a3d56f8b84eb2a057425afbf79079"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6c9a3d56f8b84eb2a057425afbf79079"}]}] Jul 05 21:04:32.014208 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Tenant: tempest-TestVolumeBootPattern-1281668618 Jul 05 21:04:32.014208 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Tenant-Id: 6c9a3d56f8b84eb2a057425afbf79079 Jul 05 21:04:32.014208 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Tenant-Name: tempest-TestVolumeBootPattern-1281668618 Jul 05 21:04:32.014208 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-User: tempest-TestVolumeBootPattern-1281668618-project Jul 05 21:04:32.014208 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-User-Domain-Id: default Jul 05 21:04:32.014208 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-User-Domain-Name: Default Jul 05 21:04:32.014208 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-User-Id: 261feb03a8ff459b8874232bec05034f Jul 05 21:04:32.014208 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-User-Name: tempest-TestVolumeBootPattern-1281668618-project Jul 05 21:04:32.014208 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: method: > Jul 05 21:04:32.014208 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: exception: Instance 843b93d3-5217-4c0f-b8a9-a335f24c615a could not be found. Jul 05 21:04:32.014208 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: action_args: {'id': '843b93d3-5217-4c0f-b8a9-a335f24c615a'} Jul 05 21:04:32.015168 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 05 21:04:32.015168 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 21:04:32.015168 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 05 21:04:32.015168 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 05 21:04:32.015168 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 05 21:04:32.015168 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 05 21:04:32.015168 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 05 21:04:32.015168 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 05 21:04:32.015168 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 05 21:04:32.015168 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 05 21:04:32.015168 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 843b93d3-5217-4c0f-b8a9-a335f24c615a could not be found. Jul 05 21:04:32.015168 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi Jul 05 21:04:32.015168 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 21:04:32.015168 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi Jul 05 21:04:32.015168 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 21:04:32.015168 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 21:04:32.015168 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 21:04:32.015168 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 05 21:04:32.015168 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 05 21:04:32.015168 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 05 21:04:32.016740 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 05 21:04:32.016740 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 05 21:04:32.016740 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 05 21:04:32.016740 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 05 21:04:32.016740 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 05 21:04:32.016740 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 05 21:04:32.016740 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 05 21:04:32.016740 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 05 21:04:32.016740 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 05 21:04:32.016740 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 843b93d3-5217-4c0f-b8a9-a335f24c615a could not be found. Jul 05 21:04:32.016740 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi Jul 05 21:04:32.016740 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 21:04:32.016740 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi Jul 05 21:04:32.016740 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 21:04:32.016740 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 21:04:32.016740 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 21:04:32.016740 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 05 21:04:32.016740 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 05 21:04:32.016740 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 843b93d3-5217-4c0f-b8a9-a335f24c615a could not be found. Jul 05 21:04:32.016740 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi Jul 05 21:04:32.018356 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-fff1ad6b-c195-4704-a75b-10b1c315b683 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Returning 404 to user: Instance 843b93d3-5217-4c0f-b8a9-a335f24c615a could not be found. {{(pid=117627) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 05 21:04:32.018356 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-fff1ad6b-c195-4704-a75b-10b1c315b683 tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] 10.222.0.20 "DELETE /compute/v2.1/servers/843b93d3-5217-4c0f-b8a9-a335f24c615a" status: 404 len: 111 microversion: 2.1 time: 0.033379 Jul 05 21:04:32.018356 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 431/885] 10.222.0.20 () {58 vars in 1238 bytes} [Tue Jul 5 21:04:31 2022] DELETE /compute/v2.1/servers/843b93d3-5217-4c0f-b8a9-a335f24c615a => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 05 21:04:32.022349 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-d19403bd-a61a-41fc-b7e2-71f30474942e tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 21:04:32.022956 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-d19403bd-a61a-41fc-b7e2-71f30474942e tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] [instance: 843b93d3-5217-4c0f-b8a9-a335f24c615a] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 21:04:32.030603 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-d19403bd-a61a-41fc-b7e2-71f30474942e tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:04:32.031305 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-d19403bd-a61a-41fc-b7e2-71f30474942e tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:04:32.032382 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-d19403bd-a61a-41fc-b7e2-71f30474942e tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:04:32.032989 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-d19403bd-a61a-41fc-b7e2-71f30474942e tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:04:32.048393 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.wsgi [None req-d19403bd-a61a-41fc-b7e2-71f30474942e tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] HTTP exception thrown: Instance 843b93d3-5217-4c0f-b8a9-a335f24c615a could not be found. Jul 05 21:04:32.049940 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-d19403bd-a61a-41fc-b7e2-71f30474942e tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Request method failure captured: Jul 05 21:04:32.049940 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: request: GET /compute/v2.1/servers/843b93d3-5217-4c0f-b8a9-a335f24c615a HTTP/1.1 Jul 05 21:04:32.049940 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: Accept: application/json Jul 05 21:04:32.049940 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: Accept-Encoding: identity Jul 05 21:04:32.049940 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: Connection: close Jul 05 21:04:32.049940 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: Content-Length: 0 Jul 05 21:04:32.049940 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: Content-Type: application/json Jul 05 21:04:32.049940 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: Host: 10.222.0.20 Jul 05 21:04:32.049940 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: Openstack-System-Scope: None Jul 05 21:04:32.049940 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: User-Agent: python-urllib3/1.26.9 Jul 05 21:04:32.049940 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Auth-Token: gAAAAABixKV-GcDC4lUNiJdOqEVVMAbZnkn9E9HC7T9UddyKTAtPpXm0wmmCXq37cCErruEoTYPrxR2enkx0RyOZqfGtr6EG-anGncOUaEEqbpXW3Rg6XJ-ohCrIXyT7Tt7TbgrLJi1wtWjTZD0cChjlb5fxi6qKGTwb9N8HmmJDYhtyE3zq-bo Jul 05 21:04:32.049940 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Domain-Id: None Jul 05 21:04:32.049940 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Domain-Name: None Jul 05 21:04:32.049940 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Identity-Status: Confirmed Jul 05 21:04:32.049940 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Is-Admin-Project: True Jul 05 21:04:32.049940 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Project-Domain-Id: default Jul 05 21:04:32.049940 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Project-Domain-Name: Default Jul 05 21:04:32.049940 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Project-Id: 6c9a3d56f8b84eb2a057425afbf79079 Jul 05 21:04:32.049940 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Project-Name: tempest-TestVolumeBootPattern-1281668618 Jul 05 21:04:32.049940 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Role: member,reader Jul 05 21:04:32.049940 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Roles: member,reader Jul 05 21:04:32.051571 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6c9a3d56f8b84eb2a057425afbf79079"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6c9a3d56f8b84eb2a057425afbf79079"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6c9a3d56f8b84eb2a057425afbf79079"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6c9a3d56f8b84eb2a057425afbf79079"}]}] Jul 05 21:04:32.051571 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Tenant: tempest-TestVolumeBootPattern-1281668618 Jul 05 21:04:32.051571 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Tenant-Id: 6c9a3d56f8b84eb2a057425afbf79079 Jul 05 21:04:32.051571 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Tenant-Name: tempest-TestVolumeBootPattern-1281668618 Jul 05 21:04:32.051571 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-User: tempest-TestVolumeBootPattern-1281668618-project Jul 05 21:04:32.051571 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-User-Domain-Id: default Jul 05 21:04:32.051571 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-User-Domain-Name: Default Jul 05 21:04:32.051571 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-User-Id: 261feb03a8ff459b8874232bec05034f Jul 05 21:04:32.051571 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-User-Name: tempest-TestVolumeBootPattern-1281668618-project Jul 05 21:04:32.051571 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: method: > Jul 05 21:04:32.051571 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: exception: Instance 843b93d3-5217-4c0f-b8a9-a335f24c615a could not be found. Jul 05 21:04:32.051571 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: action_args: {'id': '843b93d3-5217-4c0f-b8a9-a335f24c615a'} Jul 05 21:04:32.052515 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 05 21:04:32.052515 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 21:04:32.052515 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 05 21:04:32.052515 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 05 21:04:32.052515 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 05 21:04:32.052515 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 05 21:04:32.052515 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 05 21:04:32.052515 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 05 21:04:32.052515 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 05 21:04:32.052515 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 05 21:04:32.052515 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 843b93d3-5217-4c0f-b8a9-a335f24c615a could not be found. Jul 05 21:04:32.052515 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi Jul 05 21:04:32.052515 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 21:04:32.052515 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi Jul 05 21:04:32.052515 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 21:04:32.052515 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 21:04:32.052515 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 21:04:32.052515 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 05 21:04:32.052515 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 05 21:04:32.052515 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 05 21:04:32.054064 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 05 21:04:32.054064 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 05 21:04:32.054064 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 05 21:04:32.054064 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 05 21:04:32.054064 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 05 21:04:32.054064 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 05 21:04:32.054064 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 05 21:04:32.054064 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 843b93d3-5217-4c0f-b8a9-a335f24c615a could not be found. Jul 05 21:04:32.054064 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi Jul 05 21:04:32.054064 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 21:04:32.054064 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi Jul 05 21:04:32.054064 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 21:04:32.054064 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 21:04:32.054064 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 21:04:32.054064 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 05 21:04:32.054064 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 05 21:04:32.054064 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 843b93d3-5217-4c0f-b8a9-a335f24c615a could not be found. Jul 05 21:04:32.054064 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi Jul 05 21:04:32.055975 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-d19403bd-a61a-41fc-b7e2-71f30474942e tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Returning 404 to user: Instance 843b93d3-5217-4c0f-b8a9-a335f24c615a could not be found. {{(pid=117628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 05 21:04:32.055975 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-d19403bd-a61a-41fc-b7e2-71f30474942e tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] 10.222.0.20 "GET /compute/v2.1/servers/843b93d3-5217-4c0f-b8a9-a335f24c615a" status: 404 len: 111 microversion: 2.1 time: 0.032820 Jul 05 21:04:32.055975 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 455/886] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 21:04:32 2022] GET /compute/v2.1/servers/843b93d3-5217-4c0f-b8a9-a335f24c615a => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 05 21:04:33.118848 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-fa14b84d-cb4e-444e-a300-89b3875d04b0 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f045bb81-5cb2-4eaf-9f56-610dc8cbb25e"}} {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 21:04:33.119905 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-fa14b84d-cb4e-444e-a300-89b3875d04b0 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] [instance: 0dcf88d1-f7a6-4fbd-a875-93ffadf791a0] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 21:04:33.126321 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-fa14b84d-cb4e-444e-a300-89b3875d04b0 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:04:33.126797 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-fa14b84d-cb4e-444e-a300-89b3875d04b0 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:04:33.127547 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-fa14b84d-cb4e-444e-a300-89b3875d04b0 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:04:33.127969 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-fa14b84d-cb4e-444e-a300-89b3875d04b0 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:04:33.212903 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.wsgi [None req-fa14b84d-cb4e-444e-a300-89b3875d04b0 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] HTTP exception thrown: Invalid volume: volume f045bb81-5cb2-4eaf-9f56-610dc8cbb25e is already attached to instances: 0dcf88d1-f7a6-4fbd-a875-93ffadf791a0 Jul 05 21:04:33.214614 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-fa14b84d-cb4e-444e-a300-89b3875d04b0 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Request method failure captured: Jul 05 21:04:33.214614 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: request: POST /compute/v2.1/servers/0dcf88d1-f7a6-4fbd-a875-93ffadf791a0/os-volume_attachments HTTP/1.1 Jul 05 21:04:33.214614 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: Accept: application/json Jul 05 21:04:33.214614 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: Accept-Encoding: identity Jul 05 21:04:33.214614 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: Connection: close Jul 05 21:04:33.214614 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: Content-Length: 74 Jul 05 21:04:33.214614 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: Content-Type: application/json Jul 05 21:04:33.214614 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: Host: 10.222.0.20 Jul 05 21:04:33.214614 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: Openstack-System-Scope: None Jul 05 21:04:33.214614 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: User-Agent: python-urllib3/1.26.9 Jul 05 21:04:33.214614 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Auth-Token: gAAAAABixKarHgq3GWxRAKGmFwqIOMVjxqRQFJ7-2_sqqMtaV9JHslnOGPoR_FnpEoGbLd0ulAIzNEyJKhgb_3l9UkX5Mn7TVDtn4GMWZ4xzhovIj2rt_z9oCnXCy_kxP3BJwmRcgYkKaWq3r03wWEMey-TXfn-Y_kpgbvCo-kJFjtitnsjsr2E Jul 05 21:04:33.214614 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Domain-Id: None Jul 05 21:04:33.214614 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Domain-Name: None Jul 05 21:04:33.214614 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Identity-Status: Confirmed Jul 05 21:04:33.214614 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Is-Admin-Project: True Jul 05 21:04:33.214614 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Project-Domain-Id: default Jul 05 21:04:33.214614 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Project-Domain-Name: Default Jul 05 21:04:33.214614 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Project-Id: e74557ea7f0f4057b190c0adaaa80ed9 Jul 05 21:04:33.214614 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Project-Name: tempest-AttachVolumeNegativeTest-1927644848 Jul 05 21:04:33.214614 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Role: member,reader Jul 05 21:04:33.214614 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Roles: member,reader Jul 05 21:04:33.216222 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e74557ea7f0f4057b190c0adaaa80ed9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/e74557ea7f0f4057b190c0adaaa80ed9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_e74557ea7f0f4057b190c0adaaa80ed9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e74557ea7f0f4057b190c0adaaa80ed9"}]}] Jul 05 21:04:33.216222 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Tenant: tempest-AttachVolumeNegativeTest-1927644848 Jul 05 21:04:33.216222 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Tenant-Id: e74557ea7f0f4057b190c0adaaa80ed9 Jul 05 21:04:33.216222 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1927644848 Jul 05 21:04:33.216222 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-User: tempest-AttachVolumeNegativeTest-1927644848-project Jul 05 21:04:33.216222 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-User-Domain-Id: default Jul 05 21:04:33.216222 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-User-Domain-Name: Default Jul 05 21:04:33.216222 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-User-Id: 0e12538a6dd44bdd963e9850c24c04bc Jul 05 21:04:33.216222 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-User-Name: tempest-AttachVolumeNegativeTest-1927644848-project Jul 05 21:04:33.216222 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: Jul 05 21:04:33.216222 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: {"volumeAttachment": {"volumeId": "f045bb81-5cb2-4eaf-9f56-610dc8cbb25e"}} Jul 05 21:04:33.216222 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: method: > Jul 05 21:04:33.217352 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: exception: Invalid volume: volume f045bb81-5cb2-4eaf-9f56-610dc8cbb25e is already attached to instances: 0dcf88d1-f7a6-4fbd-a875-93ffadf791a0 Jul 05 21:04:33.217352 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: action_args: {'server_id': '0dcf88d1-f7a6-4fbd-a875-93ffadf791a0', 'body': {'volumeAttachment': {'volumeId': 'f045bb81-5cb2-4eaf-9f56-610dc8cbb25e'}}} Jul 05 21:04:33.217352 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 05 21:04:33.217352 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 21:04:33.217352 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 05 21:04:33.217352 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 05 21:04:33.217352 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 05 21:04:33.217352 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 05 21:04:33.217352 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 05 21:04:33.217352 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 05 21:04:33.217352 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jul 05 21:04:33.217352 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 05 21:04:33.217352 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jul 05 21:04:33.217352 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 05 21:04:33.217352 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume f045bb81-5cb2-4eaf-9f56-610dc8cbb25e is already attached to instances: 0dcf88d1-f7a6-4fbd-a875-93ffadf791a0 Jul 05 21:04:33.217352 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi Jul 05 21:04:33.217352 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 21:04:33.217352 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi Jul 05 21:04:33.217352 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 21:04:33.218837 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 21:04:33.218837 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 21:04:33.218837 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 05 21:04:33.218837 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 05 21:04:33.218837 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 05 21:04:33.218837 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 05 21:04:33.218837 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 05 21:04:33.218837 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 05 21:04:33.218837 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 05 21:04:33.218837 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 05 21:04:33.218837 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 05 21:04:33.218837 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 05 21:04:33.218837 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 05 21:04:33.218837 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 05 21:04:33.218837 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume f045bb81-5cb2-4eaf-9f56-610dc8cbb25e is already attached to instances: 0dcf88d1-f7a6-4fbd-a875-93ffadf791a0 Jul 05 21:04:33.218837 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi Jul 05 21:04:33.218837 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 21:04:33.218837 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi Jul 05 21:04:33.218837 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 21:04:33.218837 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 21:04:33.220433 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 21:04:33.220433 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 05 21:04:33.220433 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 05 21:04:33.220433 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume f045bb81-5cb2-4eaf-9f56-610dc8cbb25e is already attached to instances: 0dcf88d1-f7a6-4fbd-a875-93ffadf791a0 Jul 05 21:04:33.220433 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi Jul 05 21:04:33.220433 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-fa14b84d-cb4e-444e-a300-89b3875d04b0 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Returning 400 to user: Invalid volume: volume f045bb81-5cb2-4eaf-9f56-610dc8cbb25e is already attached to instances: 0dcf88d1-f7a6-4fbd-a875-93ffadf791a0 {{(pid=117627) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 05 21:04:33.220433 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-fa14b84d-cb4e-444e-a300-89b3875d04b0 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] 10.222.0.20 "POST /compute/v2.1/servers/0dcf88d1-f7a6-4fbd-a875-93ffadf791a0/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.102000 Jul 05 21:04:33.220433 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 432/887] 10.222.0.20 () {60 vars in 1322 bytes} [Tue Jul 5 21:04:33 2022] POST /compute/v2.1/servers/0dcf88d1-f7a6-4fbd-a875-93ffadf791a0/os-volume_attachments => generated 174 bytes in 103 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 05 21:04:33.279809 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-5042bf2e-46bb-435b-8409-999935cd4082 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 21:04:33.280390 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-5042bf2e-46bb-435b-8409-999935cd4082 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] [instance: 0dcf88d1-f7a6-4fbd-a875-93ffadf791a0] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 21:04:33.287298 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-5042bf2e-46bb-435b-8409-999935cd4082 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:04:33.287751 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-5042bf2e-46bb-435b-8409-999935cd4082 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:04:33.288514 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-5042bf2e-46bb-435b-8409-999935cd4082 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:04:33.288967 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-5042bf2e-46bb-435b-8409-999935cd4082 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:04:33.351439 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-6d834660-c42b-473f-b422-dbba91545c6c tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] Calling method '.version_select at 0x7f57cdeba310>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 21:04:33.375793 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-6d834660-c42b-473f-b422-dbba91545c6c tempest-TestVolumeBootPattern-1281668618 tempest-TestVolumeBootPattern-1281668618-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-858447728" status: 202 len: 0 microversion: 2.1 time: 0.028064 Jul 05 21:04:33.379564 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 433/888] 10.222.0.20 () {58 vars in 1259 bytes} [Tue Jul 5 21:04:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-858447728 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 05 21:04:33.400973 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.objects.instance [None req-5042bf2e-46bb-435b-8409-999935cd4082 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lazy-loading 'services' on Instance uuid 0dcf88d1-f7a6-4fbd-a875-93ffadf791a0 {{(pid=117628) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 05 21:04:33.481648 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-5042bf2e-46bb-435b-8409-999935cd4082 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] 10.222.0.20 "DELETE /compute/v2.1/servers/0dcf88d1-f7a6-4fbd-a875-93ffadf791a0/os-volume_attachments/f045bb81-5cb2-4eaf-9f56-610dc8cbb25e" status: 202 len: 0 microversion: 2.1 time: 0.205575 Jul 05 21:04:33.482461 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 456/889] 10.222.0.20 () {58 vars in 1415 bytes} [Tue Jul 5 21:04:33 2022] DELETE /compute/v2.1/servers/0dcf88d1-f7a6-4fbd-a875-93ffadf791a0/os-volume_attachments/f045bb81-5cb2-4eaf-9f56-610dc8cbb25e => generated 0 bytes in 207 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 05 21:04:33.492376 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-12696ac0-c680-4fa7-b9d6-255f2f6d232f tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 21:04:33.494111 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-12696ac0-c680-4fa7-b9d6-255f2f6d232f tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] [instance: 0dcf88d1-f7a6-4fbd-a875-93ffadf791a0] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 21:04:33.502755 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-12696ac0-c680-4fa7-b9d6-255f2f6d232f tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:04:33.503209 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-12696ac0-c680-4fa7-b9d6-255f2f6d232f tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:04:33.503985 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-12696ac0-c680-4fa7-b9d6-255f2f6d232f tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:04:33.504420 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-12696ac0-c680-4fa7-b9d6-255f2f6d232f tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:04:33.536710 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-12696ac0-c680-4fa7-b9d6-255f2f6d232f tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] 10.222.0.20 "GET /compute/v2.1/servers/0dcf88d1-f7a6-4fbd-a875-93ffadf791a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049534 Jul 05 21:04:33.537655 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 434/890] 10.222.0.20 () {58 vars in 1301 bytes} [Tue Jul 5 21:04:33 2022] GET /compute/v2.1/servers/0dcf88d1-f7a6-4fbd-a875-93ffadf791a0/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 21:04:34.550575 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-4efd8d65-c996-4f51-98f9-55312a5f0a2f tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 21:04:34.551666 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-4efd8d65-c996-4f51-98f9-55312a5f0a2f tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] [instance: 0dcf88d1-f7a6-4fbd-a875-93ffadf791a0] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 21:04:34.558914 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-4efd8d65-c996-4f51-98f9-55312a5f0a2f tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:04:34.559572 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-4efd8d65-c996-4f51-98f9-55312a5f0a2f tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:04:34.560338 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-4efd8d65-c996-4f51-98f9-55312a5f0a2f tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:04:34.560777 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-4efd8d65-c996-4f51-98f9-55312a5f0a2f tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:04:34.590916 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-4efd8d65-c996-4f51-98f9-55312a5f0a2f tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] 10.222.0.20 "GET /compute/v2.1/servers/0dcf88d1-f7a6-4fbd-a875-93ffadf791a0/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045257 Jul 05 21:04:34.591717 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 457/891] 10.222.0.20 () {58 vars in 1301 bytes} [Tue Jul 5 21:04:34 2022] GET /compute/v2.1/servers/0dcf88d1-f7a6-4fbd-a875-93ffadf791a0/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 05 21:04:34.648634 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-b71e2ed9-f9b2-4277-96ac-209805945286 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 21:04:34.649377 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-b71e2ed9-f9b2-4277-96ac-209805945286 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] [instance: 0dcf88d1-f7a6-4fbd-a875-93ffadf791a0] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 21:04:34.655731 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-b71e2ed9-f9b2-4277-96ac-209805945286 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:04:34.656177 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-b71e2ed9-f9b2-4277-96ac-209805945286 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:04:34.656958 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-b71e2ed9-f9b2-4277-96ac-209805945286 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:04:34.657397 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-b71e2ed9-f9b2-4277-96ac-209805945286 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:04:34.682931 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-b71e2ed9-f9b2-4277-96ac-209805945286 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] [instance: 0dcf88d1-f7a6-4fbd-a875-93ffadf791a0] Going to try to terminate instance {{(pid=117627) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 05 21:04:34.770364 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-b71e2ed9-f9b2-4277-96ac-209805945286 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] 10.222.0.20 "DELETE /compute/v2.1/servers/0dcf88d1-f7a6-4fbd-a875-93ffadf791a0" status: 204 len: 0 microversion: 2.1 time: 0.125214 Jul 05 21:04:34.771038 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 435/892] 10.222.0.20 () {58 vars in 1238 bytes} [Tue Jul 5 21:04:34 2022] DELETE /compute/v2.1/servers/0dcf88d1-f7a6-4fbd-a875-93ffadf791a0 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 05 21:04:34.780557 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-97ce9c75-bbf1-414d-84ae-63cecb921a52 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 21:04:34.781910 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-97ce9c75-bbf1-414d-84ae-63cecb921a52 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] [instance: 0dcf88d1-f7a6-4fbd-a875-93ffadf791a0] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 21:04:34.788433 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-97ce9c75-bbf1-414d-84ae-63cecb921a52 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:04:34.789166 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-97ce9c75-bbf1-414d-84ae-63cecb921a52 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:04:34.790451 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-97ce9c75-bbf1-414d-84ae-63cecb921a52 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:04:34.791335 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-97ce9c75-bbf1-414d-84ae-63cecb921a52 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:04:34.924939 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-97ce9c75-bbf1-414d-84ae-63cecb921a52 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e12538a6dd44bdd963e9850c24c04bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e74557ea7f0f4057b190c0adaaa80ed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 21:04:34.933293 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-97ce9c75-bbf1-414d-84ae-63cecb921a52 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] 10.222.0.20 "GET /compute/v2.1/servers/0dcf88d1-f7a6-4fbd-a875-93ffadf791a0" status: 200 len: 1681 microversion: 2.1 time: 0.156948 Jul 05 21:04:34.933860 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 458/893] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 21:04:34 2022] GET /compute/v2.1/servers/0dcf88d1-f7a6-4fbd-a875-93ffadf791a0 => generated 1681 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 21:04:35.952521 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-5d962030-3c51-4671-b1aa-8262ea75a2ab tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 21:04:35.953269 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-5d962030-3c51-4671-b1aa-8262ea75a2ab tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] [instance: 0dcf88d1-f7a6-4fbd-a875-93ffadf791a0] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 21:04:35.959859 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-5d962030-3c51-4671-b1aa-8262ea75a2ab tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:04:35.960308 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-5d962030-3c51-4671-b1aa-8262ea75a2ab tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:04:35.961113 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-5d962030-3c51-4671-b1aa-8262ea75a2ab tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:04:35.961708 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-5d962030-3c51-4671-b1aa-8262ea75a2ab tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:04:36.098597 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-5d962030-3c51-4671-b1aa-8262ea75a2ab tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e12538a6dd44bdd963e9850c24c04bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e74557ea7f0f4057b190c0adaaa80ed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 21:04:36.106662 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-5d962030-3c51-4671-b1aa-8262ea75a2ab tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] 10.222.0.20 "GET /compute/v2.1/servers/0dcf88d1-f7a6-4fbd-a875-93ffadf791a0" status: 200 len: 1681 microversion: 2.1 time: 0.159374 Jul 05 21:04:36.107235 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 436/894] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 21:04:35 2022] GET /compute/v2.1/servers/0dcf88d1-f7a6-4fbd-a875-93ffadf791a0 => generated 1681 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 21:04:37.124365 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-12328a65-7f5b-4f8e-ba22-6c9f38c9509d tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 21:04:37.124990 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-12328a65-7f5b-4f8e-ba22-6c9f38c9509d tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] [instance: 0dcf88d1-f7a6-4fbd-a875-93ffadf791a0] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 21:04:37.131567 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-12328a65-7f5b-4f8e-ba22-6c9f38c9509d tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:04:37.132021 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-12328a65-7f5b-4f8e-ba22-6c9f38c9509d tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:04:37.132786 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-12328a65-7f5b-4f8e-ba22-6c9f38c9509d tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:04:37.133457 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-12328a65-7f5b-4f8e-ba22-6c9f38c9509d tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:04:37.222781 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-12328a65-7f5b-4f8e-ba22-6c9f38c9509d tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e12538a6dd44bdd963e9850c24c04bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e74557ea7f0f4057b190c0adaaa80ed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 21:04:37.231205 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-12328a65-7f5b-4f8e-ba22-6c9f38c9509d tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] 10.222.0.20 "GET /compute/v2.1/servers/0dcf88d1-f7a6-4fbd-a875-93ffadf791a0" status: 200 len: 1614 microversion: 2.1 time: 0.110726 Jul 05 21:04:37.231972 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 459/895] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 21:04:37 2022] GET /compute/v2.1/servers/0dcf88d1-f7a6-4fbd-a875-93ffadf791a0 => generated 1614 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 21:04:37.783493 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [req-40148767-ba7d-4d56-a05b-c21f2570928c req-4d277b2b-6331-4d1b-ac60-9f368385b337 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0dcf88d1-f7a6-4fbd-a875-93ffadf791a0", "name": "network-vif-deleted", "tag": "3051664f-6676-4a9d-87ba-1294ce623d22"}]} {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 21:04:37.796436 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [req-40148767-ba7d-4d56-a05b-c21f2570928c req-4d277b2b-6331-4d1b-ac60-9f368385b337 service nova] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:04:37.797197 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [req-40148767-ba7d-4d56-a05b-c21f2570928c req-4d277b2b-6331-4d1b-ac60-9f368385b337 service nova] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:04:37.810782 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.compute.server_external_events [req-40148767-ba7d-4d56-a05b-c21f2570928c req-4d277b2b-6331-4d1b-ac60-9f368385b337 service nova] Creating event network-vif-deleted:3051664f-6676-4a9d-87ba-1294ce623d22 for instance 0dcf88d1-f7a6-4fbd-a875-93ffadf791a0 on hv-cinder-79760 Jul 05 21:04:37.817047 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [req-40148767-ba7d-4d56-a05b-c21f2570928c req-4d277b2b-6331-4d1b-ac60-9f368385b337 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046872 Jul 05 21:04:37.818145 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 437/896] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 5 21:04:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 21:04:38.249758 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-2ddc86d4-f77b-455a-97d4-0d0de3e44305 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 21:04:38.251482 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-2ddc86d4-f77b-455a-97d4-0d0de3e44305 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] [instance: 0dcf88d1-f7a6-4fbd-a875-93ffadf791a0] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 21:04:38.261205 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-2ddc86d4-f77b-455a-97d4-0d0de3e44305 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:04:38.261940 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-2ddc86d4-f77b-455a-97d4-0d0de3e44305 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:04:38.262899 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-2ddc86d4-f77b-455a-97d4-0d0de3e44305 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:04:38.263744 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-2ddc86d4-f77b-455a-97d4-0d0de3e44305 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:04:38.310012 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-2ddc86d4-f77b-455a-97d4-0d0de3e44305 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:04:38.310828 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-2ddc86d4-f77b-455a-97d4-0d0de3e44305 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:04:38.311834 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.objects.instance [None req-2ddc86d4-f77b-455a-97d4-0d0de3e44305 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lazy-loading 'fault' on Instance uuid 0dcf88d1-f7a6-4fbd-a875-93ffadf791a0 {{(pid=117628) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 05 21:04:38.386094 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-2ddc86d4-f77b-455a-97d4-0d0de3e44305 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e12538a6dd44bdd963e9850c24c04bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e74557ea7f0f4057b190c0adaaa80ed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 21:04:38.393785 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-2ddc86d4-f77b-455a-97d4-0d0de3e44305 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] 10.222.0.20 "GET /compute/v2.1/servers/0dcf88d1-f7a6-4fbd-a875-93ffadf791a0" status: 200 len: 1331 microversion: 2.1 time: 0.148655 Jul 05 21:04:38.394349 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 460/897] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 21:04:38 2022] GET /compute/v2.1/servers/0dcf88d1-f7a6-4fbd-a875-93ffadf791a0 => generated 1331 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 21:04:39.411694 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-01ffdf69-7e09-483f-b49a-0d1e53754883 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 21:04:39.412608 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-01ffdf69-7e09-483f-b49a-0d1e53754883 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] [instance: 0dcf88d1-f7a6-4fbd-a875-93ffadf791a0] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 21:04:39.419479 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-01ffdf69-7e09-483f-b49a-0d1e53754883 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:04:39.419924 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-01ffdf69-7e09-483f-b49a-0d1e53754883 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:04:39.420673 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-01ffdf69-7e09-483f-b49a-0d1e53754883 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:04:39.421130 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-01ffdf69-7e09-483f-b49a-0d1e53754883 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:04:39.425163 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG dbcounter [-] [117627] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=117627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:04:39.435443 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.wsgi [None req-01ffdf69-7e09-483f-b49a-0d1e53754883 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] HTTP exception thrown: Instance 0dcf88d1-f7a6-4fbd-a875-93ffadf791a0 could not be found. Jul 05 21:04:39.437230 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-01ffdf69-7e09-483f-b49a-0d1e53754883 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Request method failure captured: Jul 05 21:04:39.437230 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: request: GET /compute/v2.1/servers/0dcf88d1-f7a6-4fbd-a875-93ffadf791a0 HTTP/1.1 Jul 05 21:04:39.437230 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: Accept: application/json Jul 05 21:04:39.437230 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: Accept-Encoding: identity Jul 05 21:04:39.437230 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: Connection: close Jul 05 21:04:39.437230 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: Content-Length: 0 Jul 05 21:04:39.437230 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: Content-Type: application/json Jul 05 21:04:39.437230 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: Host: 10.222.0.20 Jul 05 21:04:39.437230 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: Openstack-System-Scope: None Jul 05 21:04:39.437230 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: User-Agent: python-urllib3/1.26.9 Jul 05 21:04:39.437230 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Auth-Token: gAAAAABixKarHgq3GWxRAKGmFwqIOMVjxqRQFJ7-2_sqqMtaV9JHslnOGPoR_FnpEoGbLd0ulAIzNEyJKhgb_3l9UkX5Mn7TVDtn4GMWZ4xzhovIj2rt_z9oCnXCy_kxP3BJwmRcgYkKaWq3r03wWEMey-TXfn-Y_kpgbvCo-kJFjtitnsjsr2E Jul 05 21:04:39.437230 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Domain-Id: None Jul 05 21:04:39.437230 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Domain-Name: None Jul 05 21:04:39.437230 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Identity-Status: Confirmed Jul 05 21:04:39.437230 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Is-Admin-Project: True Jul 05 21:04:39.437230 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Project-Domain-Id: default Jul 05 21:04:39.437230 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Project-Domain-Name: Default Jul 05 21:04:39.437230 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Project-Id: e74557ea7f0f4057b190c0adaaa80ed9 Jul 05 21:04:39.437230 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Project-Name: tempest-AttachVolumeNegativeTest-1927644848 Jul 05 21:04:39.437230 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Role: member,reader Jul 05 21:04:39.437230 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Roles: member,reader Jul 05 21:04:39.438909 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e74557ea7f0f4057b190c0adaaa80ed9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/e74557ea7f0f4057b190c0adaaa80ed9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_e74557ea7f0f4057b190c0adaaa80ed9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e74557ea7f0f4057b190c0adaaa80ed9"}]}] Jul 05 21:04:39.438909 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Tenant: tempest-AttachVolumeNegativeTest-1927644848 Jul 05 21:04:39.438909 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Tenant-Id: e74557ea7f0f4057b190c0adaaa80ed9 Jul 05 21:04:39.438909 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1927644848 Jul 05 21:04:39.438909 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-User: tempest-AttachVolumeNegativeTest-1927644848-project Jul 05 21:04:39.438909 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-User-Domain-Id: default Jul 05 21:04:39.438909 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-User-Domain-Name: Default Jul 05 21:04:39.438909 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-User-Id: 0e12538a6dd44bdd963e9850c24c04bc Jul 05 21:04:39.438909 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-User-Name: tempest-AttachVolumeNegativeTest-1927644848-project Jul 05 21:04:39.438909 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: method: > Jul 05 21:04:39.438909 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: exception: Instance 0dcf88d1-f7a6-4fbd-a875-93ffadf791a0 could not be found. Jul 05 21:04:39.438909 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: action_args: {'id': '0dcf88d1-f7a6-4fbd-a875-93ffadf791a0'} Jul 05 21:04:39.439836 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 05 21:04:39.439836 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 21:04:39.439836 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 05 21:04:39.439836 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 05 21:04:39.439836 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 05 21:04:39.439836 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 05 21:04:39.439836 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 05 21:04:39.439836 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 05 21:04:39.439836 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 05 21:04:39.439836 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 05 21:04:39.439836 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0dcf88d1-f7a6-4fbd-a875-93ffadf791a0 could not be found. Jul 05 21:04:39.439836 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi Jul 05 21:04:39.439836 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 21:04:39.439836 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi Jul 05 21:04:39.439836 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 21:04:39.439836 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 21:04:39.439836 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 21:04:39.439836 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 05 21:04:39.439836 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 05 21:04:39.439836 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 05 21:04:39.441434 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 05 21:04:39.441434 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 05 21:04:39.441434 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 05 21:04:39.441434 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 05 21:04:39.441434 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 05 21:04:39.441434 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 05 21:04:39.441434 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 05 21:04:39.441434 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0dcf88d1-f7a6-4fbd-a875-93ffadf791a0 could not be found. Jul 05 21:04:39.441434 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi Jul 05 21:04:39.441434 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 21:04:39.441434 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi Jul 05 21:04:39.441434 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 21:04:39.441434 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 21:04:39.441434 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 21:04:39.441434 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 05 21:04:39.441434 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 05 21:04:39.441434 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0dcf88d1-f7a6-4fbd-a875-93ffadf791a0 could not be found. Jul 05 21:04:39.441434 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi Jul 05 21:04:39.442961 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-01ffdf69-7e09-483f-b49a-0d1e53754883 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Returning 404 to user: Instance 0dcf88d1-f7a6-4fbd-a875-93ffadf791a0 could not be found. {{(pid=117627) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 05 21:04:39.442961 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-01ffdf69-7e09-483f-b49a-0d1e53754883 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] 10.222.0.20 "GET /compute/v2.1/servers/0dcf88d1-f7a6-4fbd-a875-93ffadf791a0" status: 404 len: 111 microversion: 2.1 time: 0.031529 Jul 05 21:04:39.442961 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 438/898] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 21:04:39 2022] GET /compute/v2.1/servers/0dcf88d1-f7a6-4fbd-a875-93ffadf791a0 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 05 21:04:39.448229 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-3c36c357-a16c-4e2d-b4a7-c79ec487c7a0 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Calling method '.version_select at 0x7f57cdeec9d0>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 21:04:39.467029 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-3c36c357-a16c-4e2d-b4a7-c79ec487c7a0 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1291947984" status: 202 len: 0 microversion: 2.1 time: 0.023082 Jul 05 21:04:39.467734 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 461/899] 10.222.0.20 () {58 vars in 1220 bytes} [Tue Jul 5 21:04:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1291947984 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 05 21:04:40.421459 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-3e4e103f-214c-4c1d-9e89-e2f7683bfb49 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Action: 'create', calling method: .version_select at 0x7f57cdf44b80>, body: {"keypair": {"name": "tempest-keypair-751811213", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH0l/nqkbwczaDZyP3joNELx1y9G4wUCy7fxrR6TPewy3MfBwPXDV06P1KvBXNaJxrNHKkVm/M2HqjkYWkLQhRcuYBpOfFI9ZbcrcwlMNBBo/mXFgkv8TGBWSCxaHCBe+Q=="}} {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 21:04:40.437908 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.quota [None req-3e4e103f-214c-4c1d-9e89-e2f7683bfb49 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Getting quotas for project e74557ea7f0f4057b190c0adaaa80ed9. Resources: {'key_pairs'} {{(pid=117627) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 05 21:04:40.441691 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.quota [None req-3e4e103f-214c-4c1d-9e89-e2f7683bfb49 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Getting quotas for user 0e12538a6dd44bdd963e9850c24c04bc and project e74557ea7f0f4057b190c0adaaa80ed9. Resources: {'key_pairs'} {{(pid=117627) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 05 21:04:40.464503 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-3e4e103f-214c-4c1d-9e89-e2f7683bfb49 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.050982 Jul 05 21:04:40.465024 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 439/900] 10.222.0.20 () {60 vars in 1158 bytes} [Tue Jul 5 21:04:40 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 21:04:41.887575 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-eb255656-5abb-4b9b-9349-e6a828cf2c22 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-376206106", "imageRef": "88e08f49-c01d-4849-a89f-b678588e56f4", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "97c418a5-f615-4ab3-8ff8-ab5b10a93501"}], "security_groups": [{"name": "tempest-securitygroup--753272877"}], "key_name": "tempest-keypair-751811213", "user_data": "}} {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 21:04:41.986469 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.network.neutron [None req-eb255656-5abb-4b9b-9349-e6a828cf2c22 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] validate_networks() for [('97c418a5-f615-4ab3-8ff8-ab5b10a93501', None, None, None, None, None)] {{(pid=117628) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 05 21:04:42.356944 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.virt.hardware [None req-eb255656-5abb-4b9b-9349-e6a828cf2c22 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Flavor limits 0:0:0 {{(pid=117628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 05 21:04:42.357390 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.virt.hardware [None req-eb255656-5abb-4b9b-9349-e6a828cf2c22 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Image limits 0:0:0 {{(pid=117628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 05 21:04:42.357873 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.virt.hardware [None req-eb255656-5abb-4b9b-9349-e6a828cf2c22 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Flavor pref 0:0:0 {{(pid=117628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 05 21:04:42.358273 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.virt.hardware [None req-eb255656-5abb-4b9b-9349-e6a828cf2c22 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Image pref 0:0:0 {{(pid=117628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 05 21:04:42.358682 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.virt.hardware [None req-eb255656-5abb-4b9b-9349-e6a828cf2c22 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 05 21:04:42.367351 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-eb255656-5abb-4b9b-9349-e6a828cf2c22 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:04:42.367906 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-eb255656-5abb-4b9b-9349-e6a828cf2c22 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:04:42.368693 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-eb255656-5abb-4b9b-9349-e6a828cf2c22 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:04:42.369161 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-eb255656-5abb-4b9b-9349-e6a828cf2c22 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:04:42.386161 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.quota [None req-eb255656-5abb-4b9b-9349-e6a828cf2c22 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Getting quotas for project e74557ea7f0f4057b190c0adaaa80ed9. Resources: {'cores', 'ram', 'instances'} {{(pid=117628) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 05 21:04:42.390273 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.quota [None req-eb255656-5abb-4b9b-9349-e6a828cf2c22 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Getting quotas for user 0e12538a6dd44bdd963e9850c24c04bc and project e74557ea7f0f4057b190c0adaaa80ed9. Resources: {'cores', 'ram', 'instances'} {{(pid=117628) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 05 21:04:42.403420 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-eb255656-5abb-4b9b-9349-e6a828cf2c22 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Going to run 1 instances... {{(pid=117628) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 05 21:04:42.405653 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-eb255656-5abb-4b9b-9349-e6a828cf2c22 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] [instance: 8dcf5d27-735b-4e01-954e-f724946e714b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='88e08f49-c01d-4849-a89f-b678588e56f4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117628) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 05 21:04:42.450583 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-eb255656-5abb-4b9b-9349-e6a828cf2c22 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.568435 Jul 05 21:04:42.451210 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 462/901] 10.222.0.20 () {60 vars in 1146 bytes} [Tue Jul 5 21:04:41 2022] POST /compute/v2.1/servers => generated 401 bytes in 570 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 05 21:04:42.461524 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-2b6d829f-a12e-4eea-8008-c6ddbbe5f70e tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 21:04:42.462130 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-2b6d829f-a12e-4eea-8008-c6ddbbe5f70e tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] [instance: 8dcf5d27-735b-4e01-954e-f724946e714b] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 21:04:42.523010 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-2b6d829f-a12e-4eea-8008-c6ddbbe5f70e tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e12538a6dd44bdd963e9850c24c04bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e74557ea7f0f4057b190c0adaaa80ed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 21:04:42.530430 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-2b6d829f-a12e-4eea-8008-c6ddbbe5f70e tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] 10.222.0.20 "GET /compute/v2.1/servers/8dcf5d27-735b-4e01-954e-f724946e714b" status: 200 len: 1240 microversion: 2.1 time: 0.073299 Jul 05 21:04:42.530994 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 440/902] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 21:04:42 2022] GET /compute/v2.1/servers/8dcf5d27-735b-4e01-954e-f724946e714b => generated 1240 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 21:04:43.548587 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-d27b842c-cd4c-432f-9c24-2161371faeca tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 21:04:43.549445 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-d27b842c-cd4c-432f-9c24-2161371faeca tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] [instance: 8dcf5d27-735b-4e01-954e-f724946e714b] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 21:04:43.557369 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-d27b842c-cd4c-432f-9c24-2161371faeca tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:04:43.557899 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-d27b842c-cd4c-432f-9c24-2161371faeca tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:04:43.558730 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-d27b842c-cd4c-432f-9c24-2161371faeca tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:04:43.559253 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-d27b842c-cd4c-432f-9c24-2161371faeca tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:04:43.642609 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-d27b842c-cd4c-432f-9c24-2161371faeca tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e12538a6dd44bdd963e9850c24c04bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e74557ea7f0f4057b190c0adaaa80ed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 21:04:43.653371 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-d27b842c-cd4c-432f-9c24-2161371faeca tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] 10.222.0.20 "GET /compute/v2.1/servers/8dcf5d27-735b-4e01-954e-f724946e714b" status: 200 len: 1310 microversion: 2.1 time: 0.108974 Jul 05 21:04:43.654185 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 463/903] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 21:04:43 2022] GET /compute/v2.1/servers/8dcf5d27-735b-4e01-954e-f724946e714b => generated 1310 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 21:04:44.671044 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-0a5e5e9f-5e35-4cf0-b398-4af15f2d3430 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 21:04:44.671827 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-0a5e5e9f-5e35-4cf0-b398-4af15f2d3430 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] [instance: 8dcf5d27-735b-4e01-954e-f724946e714b] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 21:04:44.678162 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-0a5e5e9f-5e35-4cf0-b398-4af15f2d3430 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:04:44.678601 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-0a5e5e9f-5e35-4cf0-b398-4af15f2d3430 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:04:44.679354 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-0a5e5e9f-5e35-4cf0-b398-4af15f2d3430 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:04:44.679776 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-0a5e5e9f-5e35-4cf0-b398-4af15f2d3430 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:04:44.913340 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-0a5e5e9f-5e35-4cf0-b398-4af15f2d3430 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e12538a6dd44bdd963e9850c24c04bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e74557ea7f0f4057b190c0adaaa80ed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 21:04:44.921450 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-0a5e5e9f-5e35-4cf0-b398-4af15f2d3430 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] 10.222.0.20 "GET /compute/v2.1/servers/8dcf5d27-735b-4e01-954e-f724946e714b" status: 200 len: 1365 microversion: 2.1 time: 0.254178 Jul 05 21:04:44.922008 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 441/904] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 21:04:44 2022] GET /compute/v2.1/servers/8dcf5d27-735b-4e01-954e-f724946e714b => generated 1365 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 21:04:45.053842 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [req-6fdd93f5-e1cf-46ea-8ce7-fef4a94a0a7e req-d603d6d9-014d-4412-860f-28236c107f9c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8dcf5d27-735b-4e01-954e-f724946e714b", "tag": "2ae5ed86-a636-405a-ac51-4305ae240c85"}]} {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 21:04:45.065863 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [req-6fdd93f5-e1cf-46ea-8ce7-fef4a94a0a7e req-d603d6d9-014d-4412-860f-28236c107f9c service nova] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:04:45.066729 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [req-6fdd93f5-e1cf-46ea-8ce7-fef4a94a0a7e req-d603d6d9-014d-4412-860f-28236c107f9c service nova] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:04:45.078683 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.compute.server_external_events [req-6fdd93f5-e1cf-46ea-8ce7-fef4a94a0a7e req-d603d6d9-014d-4412-860f-28236c107f9c service nova] Creating event network-changed:2ae5ed86-a636-405a-ac51-4305ae240c85 for instance 8dcf5d27-735b-4e01-954e-f724946e714b on hv-cinder-79760 Jul 05 21:04:45.084565 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [req-6fdd93f5-e1cf-46ea-8ce7-fef4a94a0a7e req-d603d6d9-014d-4412-860f-28236c107f9c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035446 Jul 05 21:04:45.085610 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 464/905] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 5 21:04:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 21:04:45.938936 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-a41c80b5-8fd8-4cbe-9b43-4cdf1171843c tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 21:04:45.939558 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-a41c80b5-8fd8-4cbe-9b43-4cdf1171843c tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] [instance: 8dcf5d27-735b-4e01-954e-f724946e714b] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 21:04:45.946224 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-a41c80b5-8fd8-4cbe-9b43-4cdf1171843c tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:04:45.946666 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-a41c80b5-8fd8-4cbe-9b43-4cdf1171843c tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:04:45.947420 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-a41c80b5-8fd8-4cbe-9b43-4cdf1171843c tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:04:45.947851 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-a41c80b5-8fd8-4cbe-9b43-4cdf1171843c tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:04:46.264298 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-a41c80b5-8fd8-4cbe-9b43-4cdf1171843c tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e12538a6dd44bdd963e9850c24c04bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e74557ea7f0f4057b190c0adaaa80ed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 21:04:46.271939 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-a41c80b5-8fd8-4cbe-9b43-4cdf1171843c tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] 10.222.0.20 "GET /compute/v2.1/servers/8dcf5d27-735b-4e01-954e-f724946e714b" status: 200 len: 1365 microversion: 2.1 time: 0.336788 Jul 05 21:04:46.272505 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 442/906] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 21:04:45 2022] GET /compute/v2.1/servers/8dcf5d27-735b-4e01-954e-f724946e714b => generated 1365 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 21:04:47.290636 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-3358eeb3-f2a8-40b2-9686-8bbed0637213 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 21:04:47.291354 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-3358eeb3-f2a8-40b2-9686-8bbed0637213 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] [instance: 8dcf5d27-735b-4e01-954e-f724946e714b] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 21:04:47.297630 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-3358eeb3-f2a8-40b2-9686-8bbed0637213 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:04:47.298080 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-3358eeb3-f2a8-40b2-9686-8bbed0637213 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:04:47.298837 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-3358eeb3-f2a8-40b2-9686-8bbed0637213 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:04:47.299267 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-3358eeb3-f2a8-40b2-9686-8bbed0637213 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:04:47.429216 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-3358eeb3-f2a8-40b2-9686-8bbed0637213 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e12538a6dd44bdd963e9850c24c04bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e74557ea7f0f4057b190c0adaaa80ed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 21:04:47.436573 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-3358eeb3-f2a8-40b2-9686-8bbed0637213 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] 10.222.0.20 "GET /compute/v2.1/servers/8dcf5d27-735b-4e01-954e-f724946e714b" status: 200 len: 1365 microversion: 2.1 time: 0.151256 Jul 05 21:04:47.437166 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 465/907] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 21:04:47 2022] GET /compute/v2.1/servers/8dcf5d27-735b-4e01-954e-f724946e714b => generated 1365 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 21:04:48.453952 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-8814cd95-b434-4107-9e42-02f98d625b74 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 21:04:48.454543 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-8814cd95-b434-4107-9e42-02f98d625b74 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] [instance: 8dcf5d27-735b-4e01-954e-f724946e714b] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 21:04:48.460984 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-8814cd95-b434-4107-9e42-02f98d625b74 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:04:48.462015 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-8814cd95-b434-4107-9e42-02f98d625b74 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:04:48.462757 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-8814cd95-b434-4107-9e42-02f98d625b74 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:04:48.463181 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-8814cd95-b434-4107-9e42-02f98d625b74 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:04:48.592661 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-8814cd95-b434-4107-9e42-02f98d625b74 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e12538a6dd44bdd963e9850c24c04bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e74557ea7f0f4057b190c0adaaa80ed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 21:04:48.599953 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-8814cd95-b434-4107-9e42-02f98d625b74 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] 10.222.0.20 "GET /compute/v2.1/servers/8dcf5d27-735b-4e01-954e-f724946e714b" status: 200 len: 1365 microversion: 2.1 time: 0.150126 Jul 05 21:04:48.600492 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 443/908] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 21:04:48 2022] GET /compute/v2.1/servers/8dcf5d27-735b-4e01-954e-f724946e714b => generated 1365 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 21:04:49.617313 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-c0fdb295-a4d4-4980-b4b5-9c7767ddbf4f tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 21:04:49.619213 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-c0fdb295-a4d4-4980-b4b5-9c7767ddbf4f tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] [instance: 8dcf5d27-735b-4e01-954e-f724946e714b] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 21:04:49.625688 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-c0fdb295-a4d4-4980-b4b5-9c7767ddbf4f tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:04:49.626137 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-c0fdb295-a4d4-4980-b4b5-9c7767ddbf4f tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:04:49.626891 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-c0fdb295-a4d4-4980-b4b5-9c7767ddbf4f tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:04:49.627327 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-c0fdb295-a4d4-4980-b4b5-9c7767ddbf4f tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:04:49.754847 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-c0fdb295-a4d4-4980-b4b5-9c7767ddbf4f tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e12538a6dd44bdd963e9850c24c04bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e74557ea7f0f4057b190c0adaaa80ed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 21:04:49.758926 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG dbcounter [-] [117628] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:04:49.763570 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-c0fdb295-a4d4-4980-b4b5-9c7767ddbf4f tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] 10.222.0.20 "GET /compute/v2.1/servers/8dcf5d27-735b-4e01-954e-f724946e714b" status: 200 len: 1365 microversion: 2.1 time: 0.149828 Jul 05 21:04:49.764147 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 466/909] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 21:04:49 2022] GET /compute/v2.1/servers/8dcf5d27-735b-4e01-954e-f724946e714b => generated 1365 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 21:04:50.782369 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-398111fd-0d7f-4945-8ae8-cae7163fa208 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 21:04:50.783003 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-398111fd-0d7f-4945-8ae8-cae7163fa208 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] [instance: 8dcf5d27-735b-4e01-954e-f724946e714b] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 21:04:50.785388 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG dbcounter [-] [117627] Writing DB stats nova_api:SELECT=70,nova_api:UPDATE=3,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=117627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:04:50.790698 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-398111fd-0d7f-4945-8ae8-cae7163fa208 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:04:50.791178 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-398111fd-0d7f-4945-8ae8-cae7163fa208 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:04:50.791935 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-398111fd-0d7f-4945-8ae8-cae7163fa208 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:04:50.792359 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-398111fd-0d7f-4945-8ae8-cae7163fa208 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:04:50.922580 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-398111fd-0d7f-4945-8ae8-cae7163fa208 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e12538a6dd44bdd963e9850c24c04bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e74557ea7f0f4057b190c0adaaa80ed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 21:04:50.930179 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-398111fd-0d7f-4945-8ae8-cae7163fa208 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] 10.222.0.20 "GET /compute/v2.1/servers/8dcf5d27-735b-4e01-954e-f724946e714b" status: 200 len: 1365 microversion: 2.1 time: 0.152755 Jul 05 21:04:50.930969 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 444/910] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 21:04:50 2022] GET /compute/v2.1/servers/8dcf5d27-735b-4e01-954e-f724946e714b => generated 1365 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 21:04:51.139004 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [req-b4da3367-e47b-486a-b149-842093e93bd7 req-cecf093f-fc99-413c-894d-6fb01625589b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8dcf5d27-735b-4e01-954e-f724946e714b", "name": "network-vif-plugged", "status": "completed", "tag": "2ae5ed86-a636-405a-ac51-4305ae240c85"}]} {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 21:04:51.142879 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG dbcounter [-] [117628] Writing DB stats nova_api:SELECT=59,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=117628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:04:51.152906 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [req-b4da3367-e47b-486a-b149-842093e93bd7 req-cecf093f-fc99-413c-894d-6fb01625589b service nova] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:04:51.153762 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [req-b4da3367-e47b-486a-b149-842093e93bd7 req-cecf093f-fc99-413c-894d-6fb01625589b service nova] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:04:51.167826 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.compute.server_external_events [req-b4da3367-e47b-486a-b149-842093e93bd7 req-cecf093f-fc99-413c-894d-6fb01625589b service nova] Creating event network-vif-plugged:2ae5ed86-a636-405a-ac51-4305ae240c85 for instance 8dcf5d27-735b-4e01-954e-f724946e714b on hv-cinder-79760 Jul 05 21:04:51.172958 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [req-b4da3367-e47b-486a-b149-842093e93bd7 req-cecf093f-fc99-413c-894d-6fb01625589b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038175 Jul 05 21:04:51.173550 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 467/911] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 5 21:04:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 21:04:51.947182 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-22e4d613-9096-4bc9-b313-9b744e097a08 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 21:04:51.947787 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-22e4d613-9096-4bc9-b313-9b744e097a08 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] [instance: 8dcf5d27-735b-4e01-954e-f724946e714b] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 21:04:51.954268 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-22e4d613-9096-4bc9-b313-9b744e097a08 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:04:51.954715 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-22e4d613-9096-4bc9-b313-9b744e097a08 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:04:51.955470 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-22e4d613-9096-4bc9-b313-9b744e097a08 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:04:51.955905 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-22e4d613-9096-4bc9-b313-9b744e097a08 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:04:52.081164 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-22e4d613-9096-4bc9-b313-9b744e097a08 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e12538a6dd44bdd963e9850c24c04bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e74557ea7f0f4057b190c0adaaa80ed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 21:04:52.088683 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-22e4d613-9096-4bc9-b313-9b744e097a08 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] 10.222.0.20 "GET /compute/v2.1/servers/8dcf5d27-735b-4e01-954e-f724946e714b" status: 200 len: 1365 microversion: 2.1 time: 0.145433 Jul 05 21:04:52.089275 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 445/912] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 21:04:51 2022] GET /compute/v2.1/servers/8dcf5d27-735b-4e01-954e-f724946e714b => generated 1365 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 21:04:53.106128 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-5838c957-055a-4334-9be4-abf9161e75d3 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 21:04:53.106741 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-5838c957-055a-4334-9be4-abf9161e75d3 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] [instance: 8dcf5d27-735b-4e01-954e-f724946e714b] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 21:04:53.109558 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG dbcounter [-] [117628] Writing DB stats nova_cell0:SELECT=2 {{(pid=117628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:04:53.110270 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG dbcounter [-] [117628] Writing DB stats nova_cell0:SELECT=6 {{(pid=117628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:04:53.118711 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-5838c957-055a-4334-9be4-abf9161e75d3 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:04:53.119167 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-5838c957-055a-4334-9be4-abf9161e75d3 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:04:53.119945 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-5838c957-055a-4334-9be4-abf9161e75d3 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:04:53.120386 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-5838c957-055a-4334-9be4-abf9161e75d3 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:04:53.251999 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-5838c957-055a-4334-9be4-abf9161e75d3 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e12538a6dd44bdd963e9850c24c04bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e74557ea7f0f4057b190c0adaaa80ed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 21:04:53.260276 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-5838c957-055a-4334-9be4-abf9161e75d3 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] 10.222.0.20 "GET /compute/v2.1/servers/8dcf5d27-735b-4e01-954e-f724946e714b" status: 200 len: 1555 microversion: 2.1 time: 0.159118 Jul 05 21:04:53.260829 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 468/913] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 21:04:53 2022] GET /compute/v2.1/servers/8dcf5d27-735b-4e01-954e-f724946e714b => generated 1555 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 21:04:53.276288 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-1f9f5bcb-97e6-4480-9f39-4cb4c3c43fa3 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 21:04:53.276765 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-1f9f5bcb-97e6-4480-9f39-4cb4c3c43fa3 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] [instance: 8dcf5d27-735b-4e01-954e-f724946e714b] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 21:04:53.278661 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG dbcounter [-] [117627] Writing DB stats nova_cell0:SELECT=6 {{(pid=117627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:04:53.284377 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-1f9f5bcb-97e6-4480-9f39-4cb4c3c43fa3 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:04:53.284820 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-1f9f5bcb-97e6-4480-9f39-4cb4c3c43fa3 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:04:53.285594 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-1f9f5bcb-97e6-4480-9f39-4cb4c3c43fa3 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:04:53.286025 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-1f9f5bcb-97e6-4480-9f39-4cb4c3c43fa3 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:04:53.361612 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-1f9f5bcb-97e6-4480-9f39-4cb4c3c43fa3 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] 10.222.0.20 "GET /compute/v2.1/servers/8dcf5d27-735b-4e01-954e-f724946e714b/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.089087 Jul 05 21:04:53.362198 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 446/914] 10.222.0.20 () {58 vars in 1274 bytes} [Tue Jul 5 21:04:53 2022] GET /compute/v2.1/servers/8dcf5d27-735b-4e01-954e-f724946e714b/os-interface => generated 284 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 21:04:54.533605 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [req-22ac6739-177f-435d-a0b2-0cd33c5de124 req-0d8fcaa4-d179-4815-8e7a-5dbea42d0aef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8dcf5d27-735b-4e01-954e-f724946e714b", "tag": "2ae5ed86-a636-405a-ac51-4305ae240c85"}]} {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 21:04:54.543519 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [req-22ac6739-177f-435d-a0b2-0cd33c5de124 req-0d8fcaa4-d179-4815-8e7a-5dbea42d0aef service nova] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:04:54.544012 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [req-22ac6739-177f-435d-a0b2-0cd33c5de124 req-0d8fcaa4-d179-4815-8e7a-5dbea42d0aef service nova] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:04:54.555450 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.compute.server_external_events [req-22ac6739-177f-435d-a0b2-0cd33c5de124 req-0d8fcaa4-d179-4815-8e7a-5dbea42d0aef service nova] Creating event network-changed:2ae5ed86-a636-405a-ac51-4305ae240c85 for instance 8dcf5d27-735b-4e01-954e-f724946e714b on hv-cinder-79760 Jul 05 21:04:54.561065 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [req-22ac6739-177f-435d-a0b2-0cd33c5de124 req-0d8fcaa4-d179-4815-8e7a-5dbea42d0aef service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031105 Jul 05 21:04:54.561661 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 469/915] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 5 21:04:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 21:05:30.749267 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG dbcounter [-] [117627] Writing DB stats nova_api:SELECT=5 {{(pid=117627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:05:30.750066 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG dbcounter [-] [117627] Writing DB stats nova_cell1:SELECT=34 {{(pid=117627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:05:30.754362 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-324f8854-50cb-4ee4-94ef-5ab9ef7c42b5 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 21:05:30.754851 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-324f8854-50cb-4ee4-94ef-5ab9ef7c42b5 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] [instance: 8dcf5d27-735b-4e01-954e-f724946e714b] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 21:05:30.761925 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-324f8854-50cb-4ee4-94ef-5ab9ef7c42b5 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:05:30.763256 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-324f8854-50cb-4ee4-94ef-5ab9ef7c42b5 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:05:30.763256 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-324f8854-50cb-4ee4-94ef-5ab9ef7c42b5 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:05:30.763542 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-324f8854-50cb-4ee4-94ef-5ab9ef7c42b5 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:05:30.787867 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-324f8854-50cb-4ee4-94ef-5ab9ef7c42b5 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] 10.222.0.20 "GET /compute/v2.1/servers/8dcf5d27-735b-4e01-954e-f724946e714b/ips" status: 200 len: 149 microversion: 2.1 time: 0.039941 Jul 05 21:05:30.788430 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 447/916] 10.222.0.20 () {58 vars in 1247 bytes} [Tue Jul 5 21:05:30 2022] GET /compute/v2.1/servers/8dcf5d27-735b-4e01-954e-f724946e714b/ips => generated 149 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 21:05:32.095113 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-0fabf353-3f35-4350-ab6c-e65f7333b737 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "39d75c3d-333b-458b-ae4d-98c0391e1834"}} {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 21:05:32.096278 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-0fabf353-3f35-4350-ab6c-e65f7333b737 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] [instance: 8dcf5d27-735b-4e01-954e-f724946e714b] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 21:05:32.099617 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG dbcounter [-] [117628] Writing DB stats nova_api:SELECT=5 {{(pid=117628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:05:32.100247 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG dbcounter [-] [117628] Writing DB stats nova_cell1:SELECT=10 {{(pid=117628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:05:32.105192 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-0fabf353-3f35-4350-ab6c-e65f7333b737 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:05:32.105640 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-0fabf353-3f35-4350-ab6c-e65f7333b737 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:05:32.106433 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-0fabf353-3f35-4350-ab6c-e65f7333b737 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:05:32.106868 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-0fabf353-3f35-4350-ab6c-e65f7333b737 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:05:32.353432 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-0fabf353-3f35-4350-ab6c-e65f7333b737 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] 10.222.0.20 "POST /compute/v2.1/servers/8dcf5d27-735b-4e01-954e-f724946e714b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.262309 Jul 05 21:05:32.354568 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 470/917] 10.222.0.20 () {60 vars in 1322 bytes} [Tue Jul 5 21:05:32 2022] POST /compute/v2.1/servers/8dcf5d27-735b-4e01-954e-f724946e714b/os-volume_attachments => generated 194 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 21:05:39.947604 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-0070b4b3-1322-4de3-8591-d864e40db022 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 21:05:39.948179 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-0070b4b3-1322-4de3-8591-d864e40db022 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] [instance: 8dcf5d27-735b-4e01-954e-f724946e714b] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 21:05:39.954033 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-0070b4b3-1322-4de3-8591-d864e40db022 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:05:39.954473 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-0070b4b3-1322-4de3-8591-d864e40db022 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:05:39.955214 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-0070b4b3-1322-4de3-8591-d864e40db022 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:05:39.955642 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-0070b4b3-1322-4de3-8591-d864e40db022 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:05:40.034910 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.objects.instance [None req-0070b4b3-1322-4de3-8591-d864e40db022 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lazy-loading 'services' on Instance uuid 8dcf5d27-735b-4e01-954e-f724946e714b {{(pid=117627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 05 21:05:40.107867 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-0070b4b3-1322-4de3-8591-d864e40db022 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] 10.222.0.20 "DELETE /compute/v2.1/servers/8dcf5d27-735b-4e01-954e-f724946e714b/os-volume_attachments/39d75c3d-333b-458b-ae4d-98c0391e1834" status: 202 len: 0 microversion: 2.1 time: 0.164476 Jul 05 21:05:40.108543 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 448/918] 10.222.0.20 () {58 vars in 1415 bytes} [Tue Jul 5 21:05:39 2022] DELETE /compute/v2.1/servers/8dcf5d27-735b-4e01-954e-f724946e714b/os-volume_attachments/39d75c3d-333b-458b-ae4d-98c0391e1834 => generated 0 bytes in 166 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 05 21:05:40.117977 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-bd10e57b-925c-4375-ba07-9021197d84e3 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 21:05:40.119086 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-bd10e57b-925c-4375-ba07-9021197d84e3 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] [instance: 8dcf5d27-735b-4e01-954e-f724946e714b] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 21:05:40.126025 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-bd10e57b-925c-4375-ba07-9021197d84e3 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:05:40.126469 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-bd10e57b-925c-4375-ba07-9021197d84e3 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:05:40.127234 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-bd10e57b-925c-4375-ba07-9021197d84e3 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:05:40.127664 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-bd10e57b-925c-4375-ba07-9021197d84e3 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:05:40.158457 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-bd10e57b-925c-4375-ba07-9021197d84e3 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] 10.222.0.20 "GET /compute/v2.1/servers/8dcf5d27-735b-4e01-954e-f724946e714b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045264 Jul 05 21:05:40.159015 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 471/919] 10.222.0.20 () {58 vars in 1301 bytes} [Tue Jul 5 21:05:40 2022] GET /compute/v2.1/servers/8dcf5d27-735b-4e01-954e-f724946e714b/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 21:05:41.171879 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-84dc3507-64c7-4841-b64d-fdaf419ae583 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 21:05:41.172958 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-84dc3507-64c7-4841-b64d-fdaf419ae583 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] [instance: 8dcf5d27-735b-4e01-954e-f724946e714b] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 21:05:41.179137 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-84dc3507-64c7-4841-b64d-fdaf419ae583 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:05:41.179585 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-84dc3507-64c7-4841-b64d-fdaf419ae583 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:05:41.180338 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-84dc3507-64c7-4841-b64d-fdaf419ae583 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:05:41.180769 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-84dc3507-64c7-4841-b64d-fdaf419ae583 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:05:41.208359 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-84dc3507-64c7-4841-b64d-fdaf419ae583 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] 10.222.0.20 "GET /compute/v2.1/servers/8dcf5d27-735b-4e01-954e-f724946e714b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041361 Jul 05 21:05:41.208894 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 449/920] 10.222.0.20 () {58 vars in 1301 bytes} [Tue Jul 5 21:05:41 2022] GET /compute/v2.1/servers/8dcf5d27-735b-4e01-954e-f724946e714b/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 05 21:05:41.264953 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-71b1b9a0-3fd6-4e4e-ac38-17c120671c1e tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 21:05:41.265694 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-71b1b9a0-3fd6-4e4e-ac38-17c120671c1e tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] [instance: 8dcf5d27-735b-4e01-954e-f724946e714b] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 21:05:41.271976 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-71b1b9a0-3fd6-4e4e-ac38-17c120671c1e tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:05:41.272420 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-71b1b9a0-3fd6-4e4e-ac38-17c120671c1e tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:05:41.273198 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-71b1b9a0-3fd6-4e4e-ac38-17c120671c1e tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:05:41.273633 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-71b1b9a0-3fd6-4e4e-ac38-17c120671c1e tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:05:41.299025 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-71b1b9a0-3fd6-4e4e-ac38-17c120671c1e tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] [instance: 8dcf5d27-735b-4e01-954e-f724946e714b] Going to try to terminate instance {{(pid=117628) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 05 21:05:41.373036 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-71b1b9a0-3fd6-4e4e-ac38-17c120671c1e tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] 10.222.0.20 "DELETE /compute/v2.1/servers/8dcf5d27-735b-4e01-954e-f724946e714b" status: 204 len: 0 microversion: 2.1 time: 0.111530 Jul 05 21:05:41.373615 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 472/921] 10.222.0.20 () {58 vars in 1238 bytes} [Tue Jul 5 21:05:41 2022] DELETE /compute/v2.1/servers/8dcf5d27-735b-4e01-954e-f724946e714b => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 05 21:05:41.381968 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-880eb2bf-45ba-4749-8ab8-247fb3a331f1 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 21:05:41.382580 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-880eb2bf-45ba-4749-8ab8-247fb3a331f1 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] [instance: 8dcf5d27-735b-4e01-954e-f724946e714b] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 21:05:41.389226 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-880eb2bf-45ba-4749-8ab8-247fb3a331f1 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:05:41.389674 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-880eb2bf-45ba-4749-8ab8-247fb3a331f1 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:05:41.390691 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-880eb2bf-45ba-4749-8ab8-247fb3a331f1 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:05:41.391127 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-880eb2bf-45ba-4749-8ab8-247fb3a331f1 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:05:41.516778 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-880eb2bf-45ba-4749-8ab8-247fb3a331f1 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e12538a6dd44bdd963e9850c24c04bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e74557ea7f0f4057b190c0adaaa80ed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 21:05:41.524238 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-880eb2bf-45ba-4749-8ab8-247fb3a331f1 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] 10.222.0.20 "GET /compute/v2.1/servers/8dcf5d27-735b-4e01-954e-f724946e714b" status: 200 len: 1679 microversion: 2.1 time: 0.146168 Jul 05 21:05:41.524790 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 450/922] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 21:05:41 2022] GET /compute/v2.1/servers/8dcf5d27-735b-4e01-954e-f724946e714b => generated 1679 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 21:05:42.542230 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-62b0f0e1-d27d-4716-9ff9-f65fc4fc4f7c tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 21:05:42.543146 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-62b0f0e1-d27d-4716-9ff9-f65fc4fc4f7c tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] [instance: 8dcf5d27-735b-4e01-954e-f724946e714b] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 21:05:42.549562 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-62b0f0e1-d27d-4716-9ff9-f65fc4fc4f7c tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:05:42.550002 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-62b0f0e1-d27d-4716-9ff9-f65fc4fc4f7c tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:05:42.550755 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-62b0f0e1-d27d-4716-9ff9-f65fc4fc4f7c tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:05:42.551180 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-62b0f0e1-d27d-4716-9ff9-f65fc4fc4f7c tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:05:42.678322 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-62b0f0e1-d27d-4716-9ff9-f65fc4fc4f7c tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e12538a6dd44bdd963e9850c24c04bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e74557ea7f0f4057b190c0adaaa80ed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 21:05:42.686537 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-62b0f0e1-d27d-4716-9ff9-f65fc4fc4f7c tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] 10.222.0.20 "GET /compute/v2.1/servers/8dcf5d27-735b-4e01-954e-f724946e714b" status: 200 len: 1679 microversion: 2.1 time: 0.148662 Jul 05 21:05:42.687097 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 473/923] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 21:05:42 2022] GET /compute/v2.1/servers/8dcf5d27-735b-4e01-954e-f724946e714b => generated 1679 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 21:05:43.704255 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-72d1e10c-ca41-4c60-b326-48f9c3b15bf7 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 21:05:43.705472 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-72d1e10c-ca41-4c60-b326-48f9c3b15bf7 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] [instance: 8dcf5d27-735b-4e01-954e-f724946e714b] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 21:05:43.711883 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-72d1e10c-ca41-4c60-b326-48f9c3b15bf7 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:05:43.712340 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-72d1e10c-ca41-4c60-b326-48f9c3b15bf7 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:05:43.713173 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-72d1e10c-ca41-4c60-b326-48f9c3b15bf7 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:05:43.713607 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-72d1e10c-ca41-4c60-b326-48f9c3b15bf7 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:05:43.787932 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-72d1e10c-ca41-4c60-b326-48f9c3b15bf7 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e12538a6dd44bdd963e9850c24c04bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e74557ea7f0f4057b190c0adaaa80ed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 21:05:43.798744 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-72d1e10c-ca41-4c60-b326-48f9c3b15bf7 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] 10.222.0.20 "GET /compute/v2.1/servers/8dcf5d27-735b-4e01-954e-f724946e714b" status: 200 len: 1612 microversion: 2.1 time: 0.098515 Jul 05 21:05:43.799531 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 451/924] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 21:05:43 2022] GET /compute/v2.1/servers/8dcf5d27-735b-4e01-954e-f724946e714b => generated 1612 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 21:05:44.065921 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [req-6313d33a-a953-454c-a764-efa9744ca0d1 req-dbef9d82-d09f-4a5b-86f3-7196216da363 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8dcf5d27-735b-4e01-954e-f724946e714b", "name": "network-vif-deleted", "tag": "2ae5ed86-a636-405a-ac51-4305ae240c85"}]} {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 21:05:44.077115 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [req-6313d33a-a953-454c-a764-efa9744ca0d1 req-dbef9d82-d09f-4a5b-86f3-7196216da363 service nova] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:05:44.077780 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [req-6313d33a-a953-454c-a764-efa9744ca0d1 req-dbef9d82-d09f-4a5b-86f3-7196216da363 service nova] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:05:44.091910 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.compute.server_external_events [req-6313d33a-a953-454c-a764-efa9744ca0d1 req-dbef9d82-d09f-4a5b-86f3-7196216da363 service nova] Creating event network-vif-deleted:2ae5ed86-a636-405a-ac51-4305ae240c85 for instance 8dcf5d27-735b-4e01-954e-f724946e714b on hv-cinder-79760 Jul 05 21:05:44.097202 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [req-6313d33a-a953-454c-a764-efa9744ca0d1 req-dbef9d82-d09f-4a5b-86f3-7196216da363 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.263215 Jul 05 21:05:44.097886 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 474/925] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 5 21:05:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 21:05:44.816275 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-891acf79-d713-4955-920b-757c9d7fbcb8 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 21:05:44.817748 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-891acf79-d713-4955-920b-757c9d7fbcb8 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] [instance: 8dcf5d27-735b-4e01-954e-f724946e714b] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 21:05:44.825834 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-891acf79-d713-4955-920b-757c9d7fbcb8 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:05:44.826283 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-891acf79-d713-4955-920b-757c9d7fbcb8 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:05:44.827110 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-891acf79-d713-4955-920b-757c9d7fbcb8 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:05:44.827680 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-891acf79-d713-4955-920b-757c9d7fbcb8 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:05:44.843463 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.wsgi [None req-891acf79-d713-4955-920b-757c9d7fbcb8 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] HTTP exception thrown: Instance 8dcf5d27-735b-4e01-954e-f724946e714b could not be found. Jul 05 21:05:44.845150 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-891acf79-d713-4955-920b-757c9d7fbcb8 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Request method failure captured: Jul 05 21:05:44.845150 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: request: GET /compute/v2.1/servers/8dcf5d27-735b-4e01-954e-f724946e714b HTTP/1.1 Jul 05 21:05:44.845150 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: Accept: application/json Jul 05 21:05:44.845150 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: Accept-Encoding: identity Jul 05 21:05:44.845150 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: Connection: close Jul 05 21:05:44.845150 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: Content-Length: 0 Jul 05 21:05:44.845150 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: Content-Type: application/json Jul 05 21:05:44.845150 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: Host: 10.222.0.20 Jul 05 21:05:44.845150 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: Openstack-System-Scope: None Jul 05 21:05:44.845150 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: User-Agent: python-urllib3/1.26.9 Jul 05 21:05:44.845150 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Auth-Token: gAAAAABixKarHgq3GWxRAKGmFwqIOMVjxqRQFJ7-2_sqqMtaV9JHslnOGPoR_FnpEoGbLd0ulAIzNEyJKhgb_3l9UkX5Mn7TVDtn4GMWZ4xzhovIj2rt_z9oCnXCy_kxP3BJwmRcgYkKaWq3r03wWEMey-TXfn-Y_kpgbvCo-kJFjtitnsjsr2E Jul 05 21:05:44.845150 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Domain-Id: None Jul 05 21:05:44.845150 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Domain-Name: None Jul 05 21:05:44.845150 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Identity-Status: Confirmed Jul 05 21:05:44.845150 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Is-Admin-Project: True Jul 05 21:05:44.845150 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Project-Domain-Id: default Jul 05 21:05:44.845150 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Project-Domain-Name: Default Jul 05 21:05:44.845150 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Project-Id: e74557ea7f0f4057b190c0adaaa80ed9 Jul 05 21:05:44.845150 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Project-Name: tempest-AttachVolumeNegativeTest-1927644848 Jul 05 21:05:44.845150 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Role: member,reader Jul 05 21:05:44.845150 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Roles: member,reader Jul 05 21:05:44.846915 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e74557ea7f0f4057b190c0adaaa80ed9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/e74557ea7f0f4057b190c0adaaa80ed9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_e74557ea7f0f4057b190c0adaaa80ed9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e74557ea7f0f4057b190c0adaaa80ed9"}]}] Jul 05 21:05:44.846915 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Tenant: tempest-AttachVolumeNegativeTest-1927644848 Jul 05 21:05:44.846915 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Tenant-Id: e74557ea7f0f4057b190c0adaaa80ed9 Jul 05 21:05:44.846915 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1927644848 Jul 05 21:05:44.846915 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-User: tempest-AttachVolumeNegativeTest-1927644848-project Jul 05 21:05:44.846915 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-User-Domain-Id: default Jul 05 21:05:44.846915 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-User-Domain-Name: Default Jul 05 21:05:44.846915 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-User-Id: 0e12538a6dd44bdd963e9850c24c04bc Jul 05 21:05:44.846915 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-User-Name: tempest-AttachVolumeNegativeTest-1927644848-project Jul 05 21:05:44.846915 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: method: > Jul 05 21:05:44.846915 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: exception: Instance 8dcf5d27-735b-4e01-954e-f724946e714b could not be found. Jul 05 21:05:44.846915 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: action_args: {'id': '8dcf5d27-735b-4e01-954e-f724946e714b'} Jul 05 21:05:44.847907 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 05 21:05:44.847907 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 21:05:44.847907 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 05 21:05:44.847907 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 05 21:05:44.847907 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 05 21:05:44.847907 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 05 21:05:44.847907 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 05 21:05:44.847907 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 05 21:05:44.847907 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 05 21:05:44.847907 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 05 21:05:44.847907 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8dcf5d27-735b-4e01-954e-f724946e714b could not be found. Jul 05 21:05:44.847907 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi Jul 05 21:05:44.847907 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 21:05:44.847907 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi Jul 05 21:05:44.847907 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 21:05:44.847907 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 21:05:44.847907 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 21:05:44.847907 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 05 21:05:44.847907 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 05 21:05:44.847907 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 05 21:05:44.849646 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 05 21:05:44.849646 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 05 21:05:44.849646 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 05 21:05:44.849646 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 05 21:05:44.849646 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 05 21:05:44.849646 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 05 21:05:44.849646 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 05 21:05:44.849646 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8dcf5d27-735b-4e01-954e-f724946e714b could not be found. Jul 05 21:05:44.849646 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi Jul 05 21:05:44.849646 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 21:05:44.849646 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi Jul 05 21:05:44.849646 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 21:05:44.849646 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 21:05:44.849646 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 21:05:44.849646 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 05 21:05:44.849646 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 05 21:05:44.849646 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8dcf5d27-735b-4e01-954e-f724946e714b could not be found. Jul 05 21:05:44.849646 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi Jul 05 21:05:44.851020 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-891acf79-d713-4955-920b-757c9d7fbcb8 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Returning 404 to user: Instance 8dcf5d27-735b-4e01-954e-f724946e714b could not be found. {{(pid=117627) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 05 21:05:44.851020 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-891acf79-d713-4955-920b-757c9d7fbcb8 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] 10.222.0.20 "GET /compute/v2.1/servers/8dcf5d27-735b-4e01-954e-f724946e714b" status: 404 len: 111 microversion: 2.1 time: 0.034320 Jul 05 21:05:44.851020 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 452/926] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 21:05:44 2022] GET /compute/v2.1/servers/8dcf5d27-735b-4e01-954e-f724946e714b => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 05 21:05:44.856974 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-21ac6625-ab26-48dd-8dee-c9c054f2364b tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Calling method '.version_select at 0x7f57cdfebca0>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 21:05:44.876103 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-21ac6625-ab26-48dd-8dee-c9c054f2364b tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-751811213" status: 202 len: 0 microversion: 2.1 time: 0.023903 Jul 05 21:05:44.876759 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 475/927] 10.222.0.20 () {58 vars in 1217 bytes} [Tue Jul 5 21:05:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-751811213 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 05 21:05:46.621537 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-4eb11b36-6783-4980-885b-31b5efdbf966 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 21:05:46.622025 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-4eb11b36-6783-4980-885b-31b5efdbf966 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] [instance: 8dcf5d27-735b-4e01-954e-f724946e714b] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 21:05:46.628432 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-4eb11b36-6783-4980-885b-31b5efdbf966 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:05:46.628882 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-4eb11b36-6783-4980-885b-31b5efdbf966 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:05:46.629678 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-4eb11b36-6783-4980-885b-31b5efdbf966 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:05:46.630113 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-4eb11b36-6783-4980-885b-31b5efdbf966 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:05:46.644035 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.wsgi [None req-4eb11b36-6783-4980-885b-31b5efdbf966 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] HTTP exception thrown: Instance 8dcf5d27-735b-4e01-954e-f724946e714b could not be found. Jul 05 21:05:46.645586 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-4eb11b36-6783-4980-885b-31b5efdbf966 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Request method failure captured: Jul 05 21:05:46.645586 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: request: DELETE /compute/v2.1/servers/8dcf5d27-735b-4e01-954e-f724946e714b HTTP/1.1 Jul 05 21:05:46.645586 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: Accept: application/json Jul 05 21:05:46.645586 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: Accept-Encoding: identity Jul 05 21:05:46.645586 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: Connection: close Jul 05 21:05:46.645586 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: Content-Length: 0 Jul 05 21:05:46.645586 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: Content-Type: application/json Jul 05 21:05:46.645586 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: Host: 10.222.0.20 Jul 05 21:05:46.645586 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: Openstack-System-Scope: None Jul 05 21:05:46.645586 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: User-Agent: python-urllib3/1.26.9 Jul 05 21:05:46.645586 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Auth-Token: gAAAAABixKarHgq3GWxRAKGmFwqIOMVjxqRQFJ7-2_sqqMtaV9JHslnOGPoR_FnpEoGbLd0ulAIzNEyJKhgb_3l9UkX5Mn7TVDtn4GMWZ4xzhovIj2rt_z9oCnXCy_kxP3BJwmRcgYkKaWq3r03wWEMey-TXfn-Y_kpgbvCo-kJFjtitnsjsr2E Jul 05 21:05:46.645586 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Domain-Id: None Jul 05 21:05:46.645586 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Domain-Name: None Jul 05 21:05:46.645586 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Identity-Status: Confirmed Jul 05 21:05:46.645586 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Is-Admin-Project: True Jul 05 21:05:46.645586 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Project-Domain-Id: default Jul 05 21:05:46.645586 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Project-Domain-Name: Default Jul 05 21:05:46.645586 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Project-Id: e74557ea7f0f4057b190c0adaaa80ed9 Jul 05 21:05:46.645586 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Project-Name: tempest-AttachVolumeNegativeTest-1927644848 Jul 05 21:05:46.645586 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Role: member,reader Jul 05 21:05:46.645586 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Roles: member,reader Jul 05 21:05:46.647247 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e74557ea7f0f4057b190c0adaaa80ed9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/e74557ea7f0f4057b190c0adaaa80ed9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_e74557ea7f0f4057b190c0adaaa80ed9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e74557ea7f0f4057b190c0adaaa80ed9"}]}] Jul 05 21:05:46.647247 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Tenant: tempest-AttachVolumeNegativeTest-1927644848 Jul 05 21:05:46.647247 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Tenant-Id: e74557ea7f0f4057b190c0adaaa80ed9 Jul 05 21:05:46.647247 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1927644848 Jul 05 21:05:46.647247 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-User: tempest-AttachVolumeNegativeTest-1927644848-project Jul 05 21:05:46.647247 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-User-Domain-Id: default Jul 05 21:05:46.647247 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-User-Domain-Name: Default Jul 05 21:05:46.647247 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-User-Id: 0e12538a6dd44bdd963e9850c24c04bc Jul 05 21:05:46.647247 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-User-Name: tempest-AttachVolumeNegativeTest-1927644848-project Jul 05 21:05:46.647247 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: method: > Jul 05 21:05:46.647247 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: exception: Instance 8dcf5d27-735b-4e01-954e-f724946e714b could not be found. Jul 05 21:05:46.647247 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: action_args: {'id': '8dcf5d27-735b-4e01-954e-f724946e714b'} Jul 05 21:05:46.648188 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 05 21:05:46.648188 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 21:05:46.648188 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 05 21:05:46.648188 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 05 21:05:46.648188 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 05 21:05:46.648188 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 05 21:05:46.648188 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 05 21:05:46.648188 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 05 21:05:46.648188 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 05 21:05:46.648188 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 05 21:05:46.648188 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8dcf5d27-735b-4e01-954e-f724946e714b could not be found. Jul 05 21:05:46.648188 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi Jul 05 21:05:46.648188 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 21:05:46.648188 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi Jul 05 21:05:46.648188 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 21:05:46.648188 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 21:05:46.648188 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 21:05:46.648188 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 05 21:05:46.648188 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 05 21:05:46.648188 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 05 21:05:46.649735 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 05 21:05:46.649735 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 05 21:05:46.649735 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 05 21:05:46.649735 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 05 21:05:46.649735 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 05 21:05:46.649735 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 05 21:05:46.649735 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 05 21:05:46.649735 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 05 21:05:46.649735 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 05 21:05:46.649735 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8dcf5d27-735b-4e01-954e-f724946e714b could not be found. Jul 05 21:05:46.649735 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi Jul 05 21:05:46.649735 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 21:05:46.649735 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi Jul 05 21:05:46.649735 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 21:05:46.649735 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 21:05:46.649735 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 21:05:46.649735 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 05 21:05:46.649735 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 05 21:05:46.649735 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8dcf5d27-735b-4e01-954e-f724946e714b could not be found. Jul 05 21:05:46.649735 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi Jul 05 21:05:46.652038 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-4eb11b36-6783-4980-885b-31b5efdbf966 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Returning 404 to user: Instance 8dcf5d27-735b-4e01-954e-f724946e714b could not be found. {{(pid=117627) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 05 21:05:46.652038 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-4eb11b36-6783-4980-885b-31b5efdbf966 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] 10.222.0.20 "DELETE /compute/v2.1/servers/8dcf5d27-735b-4e01-954e-f724946e714b" status: 404 len: 111 microversion: 2.1 time: 0.029290 Jul 05 21:05:46.652038 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 453/928] 10.222.0.20 () {58 vars in 1238 bytes} [Tue Jul 5 21:05:46 2022] DELETE /compute/v2.1/servers/8dcf5d27-735b-4e01-954e-f724946e714b => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 05 21:05:46.656157 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-f7daf52b-6d94-46a6-9fcf-2fe00a6e0dc2 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 21:05:46.656888 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-f7daf52b-6d94-46a6-9fcf-2fe00a6e0dc2 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] [instance: 8dcf5d27-735b-4e01-954e-f724946e714b] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 21:05:46.663540 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-f7daf52b-6d94-46a6-9fcf-2fe00a6e0dc2 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:05:46.663986 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-f7daf52b-6d94-46a6-9fcf-2fe00a6e0dc2 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:05:46.664740 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-f7daf52b-6d94-46a6-9fcf-2fe00a6e0dc2 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:05:46.665197 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-f7daf52b-6d94-46a6-9fcf-2fe00a6e0dc2 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:05:46.677867 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.wsgi [None req-f7daf52b-6d94-46a6-9fcf-2fe00a6e0dc2 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] HTTP exception thrown: Instance 8dcf5d27-735b-4e01-954e-f724946e714b could not be found. Jul 05 21:05:46.679455 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-f7daf52b-6d94-46a6-9fcf-2fe00a6e0dc2 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Request method failure captured: Jul 05 21:05:46.679455 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: request: GET /compute/v2.1/servers/8dcf5d27-735b-4e01-954e-f724946e714b HTTP/1.1 Jul 05 21:05:46.679455 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: Accept: application/json Jul 05 21:05:46.679455 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: Accept-Encoding: identity Jul 05 21:05:46.679455 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: Connection: close Jul 05 21:05:46.679455 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: Content-Length: 0 Jul 05 21:05:46.679455 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: Content-Type: application/json Jul 05 21:05:46.679455 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: Host: 10.222.0.20 Jul 05 21:05:46.679455 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: Openstack-System-Scope: None Jul 05 21:05:46.679455 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: User-Agent: python-urllib3/1.26.9 Jul 05 21:05:46.679455 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Auth-Token: gAAAAABixKarHgq3GWxRAKGmFwqIOMVjxqRQFJ7-2_sqqMtaV9JHslnOGPoR_FnpEoGbLd0ulAIzNEyJKhgb_3l9UkX5Mn7TVDtn4GMWZ4xzhovIj2rt_z9oCnXCy_kxP3BJwmRcgYkKaWq3r03wWEMey-TXfn-Y_kpgbvCo-kJFjtitnsjsr2E Jul 05 21:05:46.679455 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Domain-Id: None Jul 05 21:05:46.679455 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Domain-Name: None Jul 05 21:05:46.679455 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Identity-Status: Confirmed Jul 05 21:05:46.679455 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Is-Admin-Project: True Jul 05 21:05:46.679455 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Project-Domain-Id: default Jul 05 21:05:46.679455 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Project-Domain-Name: Default Jul 05 21:05:46.679455 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Project-Id: e74557ea7f0f4057b190c0adaaa80ed9 Jul 05 21:05:46.679455 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Project-Name: tempest-AttachVolumeNegativeTest-1927644848 Jul 05 21:05:46.679455 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Role: member,reader Jul 05 21:05:46.679455 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Roles: member,reader Jul 05 21:05:46.681080 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e74557ea7f0f4057b190c0adaaa80ed9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/e74557ea7f0f4057b190c0adaaa80ed9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_e74557ea7f0f4057b190c0adaaa80ed9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e74557ea7f0f4057b190c0adaaa80ed9"}]}] Jul 05 21:05:46.681080 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Tenant: tempest-AttachVolumeNegativeTest-1927644848 Jul 05 21:05:46.681080 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Tenant-Id: e74557ea7f0f4057b190c0adaaa80ed9 Jul 05 21:05:46.681080 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1927644848 Jul 05 21:05:46.681080 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-User: tempest-AttachVolumeNegativeTest-1927644848-project Jul 05 21:05:46.681080 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-User-Domain-Id: default Jul 05 21:05:46.681080 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-User-Domain-Name: Default Jul 05 21:05:46.681080 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-User-Id: 0e12538a6dd44bdd963e9850c24c04bc Jul 05 21:05:46.681080 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-User-Name: tempest-AttachVolumeNegativeTest-1927644848-project Jul 05 21:05:46.681080 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: method: > Jul 05 21:05:46.681080 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: exception: Instance 8dcf5d27-735b-4e01-954e-f724946e714b could not be found. Jul 05 21:05:46.681080 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: action_args: {'id': '8dcf5d27-735b-4e01-954e-f724946e714b'} Jul 05 21:05:46.682042 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 05 21:05:46.682042 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 21:05:46.682042 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 05 21:05:46.682042 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 05 21:05:46.682042 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 05 21:05:46.682042 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 05 21:05:46.682042 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 05 21:05:46.682042 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 05 21:05:46.682042 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 05 21:05:46.682042 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 05 21:05:46.682042 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8dcf5d27-735b-4e01-954e-f724946e714b could not be found. Jul 05 21:05:46.682042 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi Jul 05 21:05:46.682042 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 21:05:46.682042 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi Jul 05 21:05:46.682042 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 21:05:46.682042 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 21:05:46.682042 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 21:05:46.682042 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 05 21:05:46.682042 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 05 21:05:46.682042 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 05 21:05:46.683719 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 05 21:05:46.683719 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 05 21:05:46.683719 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 05 21:05:46.683719 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 05 21:05:46.683719 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 05 21:05:46.683719 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 05 21:05:46.683719 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 05 21:05:46.683719 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8dcf5d27-735b-4e01-954e-f724946e714b could not be found. Jul 05 21:05:46.683719 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi Jul 05 21:05:46.683719 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 21:05:46.683719 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi Jul 05 21:05:46.683719 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 21:05:46.683719 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 21:05:46.683719 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 21:05:46.683719 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 05 21:05:46.683719 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 05 21:05:46.683719 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8dcf5d27-735b-4e01-954e-f724946e714b could not be found. Jul 05 21:05:46.683719 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi Jul 05 21:05:46.685117 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-f7daf52b-6d94-46a6-9fcf-2fe00a6e0dc2 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Returning 404 to user: Instance 8dcf5d27-735b-4e01-954e-f724946e714b could not be found. {{(pid=117628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 05 21:05:46.685117 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-f7daf52b-6d94-46a6-9fcf-2fe00a6e0dc2 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] 10.222.0.20 "GET /compute/v2.1/servers/8dcf5d27-735b-4e01-954e-f724946e714b" status: 404 len: 111 microversion: 2.1 time: 0.028919 Jul 05 21:05:46.685117 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 476/929] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 21:05:46 2022] GET /compute/v2.1/servers/8dcf5d27-735b-4e01-954e-f724946e714b => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 05 21:05:47.815901 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-fc7c0f72-b04b-4564-9910-c3696093b37b tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 21:05:47.816425 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-fc7c0f72-b04b-4564-9910-c3696093b37b tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] [instance: 0dcf88d1-f7a6-4fbd-a875-93ffadf791a0] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 21:05:47.823921 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-fc7c0f72-b04b-4564-9910-c3696093b37b tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:05:47.824368 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-fc7c0f72-b04b-4564-9910-c3696093b37b tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:05:47.825156 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-fc7c0f72-b04b-4564-9910-c3696093b37b tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:05:47.825598 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-fc7c0f72-b04b-4564-9910-c3696093b37b tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:05:47.839102 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.wsgi [None req-fc7c0f72-b04b-4564-9910-c3696093b37b tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] HTTP exception thrown: Instance 0dcf88d1-f7a6-4fbd-a875-93ffadf791a0 could not be found. Jul 05 21:05:47.840619 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-fc7c0f72-b04b-4564-9910-c3696093b37b tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Request method failure captured: Jul 05 21:05:47.840619 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: request: DELETE /compute/v2.1/servers/0dcf88d1-f7a6-4fbd-a875-93ffadf791a0 HTTP/1.1 Jul 05 21:05:47.840619 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: Accept: application/json Jul 05 21:05:47.840619 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: Accept-Encoding: identity Jul 05 21:05:47.840619 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: Connection: close Jul 05 21:05:47.840619 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: Content-Length: 0 Jul 05 21:05:47.840619 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: Content-Type: application/json Jul 05 21:05:47.840619 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: Host: 10.222.0.20 Jul 05 21:05:47.840619 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: Openstack-System-Scope: None Jul 05 21:05:47.840619 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: User-Agent: python-urllib3/1.26.9 Jul 05 21:05:47.840619 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Auth-Token: gAAAAABixKarHgq3GWxRAKGmFwqIOMVjxqRQFJ7-2_sqqMtaV9JHslnOGPoR_FnpEoGbLd0ulAIzNEyJKhgb_3l9UkX5Mn7TVDtn4GMWZ4xzhovIj2rt_z9oCnXCy_kxP3BJwmRcgYkKaWq3r03wWEMey-TXfn-Y_kpgbvCo-kJFjtitnsjsr2E Jul 05 21:05:47.840619 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Domain-Id: None Jul 05 21:05:47.840619 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Domain-Name: None Jul 05 21:05:47.840619 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Identity-Status: Confirmed Jul 05 21:05:47.840619 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Is-Admin-Project: True Jul 05 21:05:47.840619 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Project-Domain-Id: default Jul 05 21:05:47.840619 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Project-Domain-Name: Default Jul 05 21:05:47.840619 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Project-Id: e74557ea7f0f4057b190c0adaaa80ed9 Jul 05 21:05:47.840619 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Project-Name: tempest-AttachVolumeNegativeTest-1927644848 Jul 05 21:05:47.840619 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Role: member,reader Jul 05 21:05:47.840619 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Roles: member,reader Jul 05 21:05:47.842243 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e74557ea7f0f4057b190c0adaaa80ed9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/e74557ea7f0f4057b190c0adaaa80ed9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_e74557ea7f0f4057b190c0adaaa80ed9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e74557ea7f0f4057b190c0adaaa80ed9"}]}] Jul 05 21:05:47.842243 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Tenant: tempest-AttachVolumeNegativeTest-1927644848 Jul 05 21:05:47.842243 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Tenant-Id: e74557ea7f0f4057b190c0adaaa80ed9 Jul 05 21:05:47.842243 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1927644848 Jul 05 21:05:47.842243 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-User: tempest-AttachVolumeNegativeTest-1927644848-project Jul 05 21:05:47.842243 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-User-Domain-Id: default Jul 05 21:05:47.842243 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-User-Domain-Name: Default Jul 05 21:05:47.842243 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-User-Id: 0e12538a6dd44bdd963e9850c24c04bc Jul 05 21:05:47.842243 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-User-Name: tempest-AttachVolumeNegativeTest-1927644848-project Jul 05 21:05:47.842243 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: method: > Jul 05 21:05:47.842243 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: exception: Instance 0dcf88d1-f7a6-4fbd-a875-93ffadf791a0 could not be found. Jul 05 21:05:47.842243 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: action_args: {'id': '0dcf88d1-f7a6-4fbd-a875-93ffadf791a0'} Jul 05 21:05:47.843162 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 05 21:05:47.843162 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 21:05:47.843162 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 05 21:05:47.843162 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 05 21:05:47.843162 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 05 21:05:47.843162 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 05 21:05:47.843162 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 05 21:05:47.843162 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 05 21:05:47.843162 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 05 21:05:47.843162 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 05 21:05:47.843162 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0dcf88d1-f7a6-4fbd-a875-93ffadf791a0 could not be found. Jul 05 21:05:47.843162 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi Jul 05 21:05:47.843162 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 21:05:47.843162 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi Jul 05 21:05:47.843162 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 21:05:47.843162 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 21:05:47.843162 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 21:05:47.843162 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 05 21:05:47.843162 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 05 21:05:47.843162 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 05 21:05:47.844682 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 05 21:05:47.844682 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 05 21:05:47.844682 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 05 21:05:47.844682 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 05 21:05:47.844682 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 05 21:05:47.844682 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 05 21:05:47.844682 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 05 21:05:47.844682 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 05 21:05:47.844682 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 05 21:05:47.844682 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0dcf88d1-f7a6-4fbd-a875-93ffadf791a0 could not be found. Jul 05 21:05:47.844682 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi Jul 05 21:05:47.844682 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 21:05:47.844682 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi Jul 05 21:05:47.844682 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 21:05:47.844682 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 21:05:47.844682 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 21:05:47.844682 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 05 21:05:47.844682 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 05 21:05:47.844682 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0dcf88d1-f7a6-4fbd-a875-93ffadf791a0 could not be found. Jul 05 21:05:47.844682 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi Jul 05 21:05:47.846243 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-fc7c0f72-b04b-4564-9910-c3696093b37b tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Returning 404 to user: Instance 0dcf88d1-f7a6-4fbd-a875-93ffadf791a0 could not be found. {{(pid=117627) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 05 21:05:47.846243 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-fc7c0f72-b04b-4564-9910-c3696093b37b tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] 10.222.0.20 "DELETE /compute/v2.1/servers/0dcf88d1-f7a6-4fbd-a875-93ffadf791a0" status: 404 len: 111 microversion: 2.1 time: 0.029921 Jul 05 21:05:47.846243 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 454/930] 10.222.0.20 () {58 vars in 1238 bytes} [Tue Jul 5 21:05:47 2022] DELETE /compute/v2.1/servers/0dcf88d1-f7a6-4fbd-a875-93ffadf791a0 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 05 21:05:47.850180 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-ab553acd-46f3-4e42-8471-83a6a9bedb13 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 21:05:47.850793 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-ab553acd-46f3-4e42-8471-83a6a9bedb13 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] [instance: 0dcf88d1-f7a6-4fbd-a875-93ffadf791a0] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 21:05:47.856894 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-ab553acd-46f3-4e42-8471-83a6a9bedb13 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:05:47.857361 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-ab553acd-46f3-4e42-8471-83a6a9bedb13 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:05:47.858121 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-ab553acd-46f3-4e42-8471-83a6a9bedb13 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:05:47.858538 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-ab553acd-46f3-4e42-8471-83a6a9bedb13 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:05:47.872070 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.wsgi [None req-ab553acd-46f3-4e42-8471-83a6a9bedb13 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] HTTP exception thrown: Instance 0dcf88d1-f7a6-4fbd-a875-93ffadf791a0 could not be found. Jul 05 21:05:47.873591 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-ab553acd-46f3-4e42-8471-83a6a9bedb13 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Request method failure captured: Jul 05 21:05:47.873591 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: request: GET /compute/v2.1/servers/0dcf88d1-f7a6-4fbd-a875-93ffadf791a0 HTTP/1.1 Jul 05 21:05:47.873591 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: Accept: application/json Jul 05 21:05:47.873591 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: Accept-Encoding: identity Jul 05 21:05:47.873591 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: Connection: close Jul 05 21:05:47.873591 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: Content-Length: 0 Jul 05 21:05:47.873591 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: Content-Type: application/json Jul 05 21:05:47.873591 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: Host: 10.222.0.20 Jul 05 21:05:47.873591 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: Openstack-System-Scope: None Jul 05 21:05:47.873591 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: User-Agent: python-urllib3/1.26.9 Jul 05 21:05:47.873591 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Auth-Token: gAAAAABixKarHgq3GWxRAKGmFwqIOMVjxqRQFJ7-2_sqqMtaV9JHslnOGPoR_FnpEoGbLd0ulAIzNEyJKhgb_3l9UkX5Mn7TVDtn4GMWZ4xzhovIj2rt_z9oCnXCy_kxP3BJwmRcgYkKaWq3r03wWEMey-TXfn-Y_kpgbvCo-kJFjtitnsjsr2E Jul 05 21:05:47.873591 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Domain-Id: None Jul 05 21:05:47.873591 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Domain-Name: None Jul 05 21:05:47.873591 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Identity-Status: Confirmed Jul 05 21:05:47.873591 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Is-Admin-Project: True Jul 05 21:05:47.873591 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Project-Domain-Id: default Jul 05 21:05:47.873591 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Project-Domain-Name: Default Jul 05 21:05:47.873591 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Project-Id: e74557ea7f0f4057b190c0adaaa80ed9 Jul 05 21:05:47.873591 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Project-Name: tempest-AttachVolumeNegativeTest-1927644848 Jul 05 21:05:47.873591 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Role: member,reader Jul 05 21:05:47.873591 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Roles: member,reader Jul 05 21:05:47.875202 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e74557ea7f0f4057b190c0adaaa80ed9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/e74557ea7f0f4057b190c0adaaa80ed9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_e74557ea7f0f4057b190c0adaaa80ed9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e74557ea7f0f4057b190c0adaaa80ed9"}]}] Jul 05 21:05:47.875202 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Tenant: tempest-AttachVolumeNegativeTest-1927644848 Jul 05 21:05:47.875202 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Tenant-Id: e74557ea7f0f4057b190c0adaaa80ed9 Jul 05 21:05:47.875202 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1927644848 Jul 05 21:05:47.875202 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-User: tempest-AttachVolumeNegativeTest-1927644848-project Jul 05 21:05:47.875202 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-User-Domain-Id: default Jul 05 21:05:47.875202 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-User-Domain-Name: Default Jul 05 21:05:47.875202 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-User-Id: 0e12538a6dd44bdd963e9850c24c04bc Jul 05 21:05:47.875202 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-User-Name: tempest-AttachVolumeNegativeTest-1927644848-project Jul 05 21:05:47.875202 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: method: > Jul 05 21:05:47.875202 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: exception: Instance 0dcf88d1-f7a6-4fbd-a875-93ffadf791a0 could not be found. Jul 05 21:05:47.875202 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: action_args: {'id': '0dcf88d1-f7a6-4fbd-a875-93ffadf791a0'} Jul 05 21:05:47.876159 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 05 21:05:47.876159 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 21:05:47.876159 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 05 21:05:47.876159 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 05 21:05:47.876159 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 05 21:05:47.876159 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 05 21:05:47.876159 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 05 21:05:47.876159 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 05 21:05:47.876159 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 05 21:05:47.876159 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 05 21:05:47.876159 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0dcf88d1-f7a6-4fbd-a875-93ffadf791a0 could not be found. Jul 05 21:05:47.876159 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi Jul 05 21:05:47.876159 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 21:05:47.876159 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi Jul 05 21:05:47.876159 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 21:05:47.876159 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 21:05:47.876159 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 21:05:47.876159 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 05 21:05:47.876159 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 05 21:05:47.876159 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 05 21:05:47.877674 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 05 21:05:47.877674 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 05 21:05:47.877674 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 05 21:05:47.877674 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 05 21:05:47.877674 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 05 21:05:47.877674 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 05 21:05:47.877674 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 05 21:05:47.877674 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0dcf88d1-f7a6-4fbd-a875-93ffadf791a0 could not be found. Jul 05 21:05:47.877674 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi Jul 05 21:05:47.877674 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 21:05:47.877674 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi Jul 05 21:05:47.877674 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 21:05:47.877674 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 21:05:47.877674 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 21:05:47.877674 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 05 21:05:47.877674 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 05 21:05:47.877674 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0dcf88d1-f7a6-4fbd-a875-93ffadf791a0 could not be found. Jul 05 21:05:47.877674 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi Jul 05 21:05:47.879018 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-ab553acd-46f3-4e42-8471-83a6a9bedb13 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Returning 404 to user: Instance 0dcf88d1-f7a6-4fbd-a875-93ffadf791a0 could not be found. {{(pid=117628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 05 21:05:47.879018 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-ab553acd-46f3-4e42-8471-83a6a9bedb13 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] 10.222.0.20 "GET /compute/v2.1/servers/0dcf88d1-f7a6-4fbd-a875-93ffadf791a0" status: 404 len: 111 microversion: 2.1 time: 0.028499 Jul 05 21:05:47.879018 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 477/931] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 21:05:47 2022] GET /compute/v2.1/servers/0dcf88d1-f7a6-4fbd-a875-93ffadf791a0 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 05 21:05:47.883316 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-056e3478-b69b-47f7-acf8-da17c7d0832e tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 21:05:47.883812 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-056e3478-b69b-47f7-acf8-da17c7d0832e tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] [instance: db7345ee-2fba-477b-8841-dc561c29e754] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 21:05:47.892585 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-056e3478-b69b-47f7-acf8-da17c7d0832e tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:05:47.893353 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-056e3478-b69b-47f7-acf8-da17c7d0832e tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:05:47.894134 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-056e3478-b69b-47f7-acf8-da17c7d0832e tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:05:47.894576 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-056e3478-b69b-47f7-acf8-da17c7d0832e tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:05:47.907838 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.wsgi [None req-056e3478-b69b-47f7-acf8-da17c7d0832e tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] HTTP exception thrown: Instance db7345ee-2fba-477b-8841-dc561c29e754 could not be found. Jul 05 21:05:47.909399 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-056e3478-b69b-47f7-acf8-da17c7d0832e tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Request method failure captured: Jul 05 21:05:47.909399 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: request: DELETE /compute/v2.1/servers/db7345ee-2fba-477b-8841-dc561c29e754 HTTP/1.1 Jul 05 21:05:47.909399 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: Accept: application/json Jul 05 21:05:47.909399 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: Accept-Encoding: identity Jul 05 21:05:47.909399 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: Connection: close Jul 05 21:05:47.909399 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: Content-Length: 0 Jul 05 21:05:47.909399 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: Content-Type: application/json Jul 05 21:05:47.909399 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: Host: 10.222.0.20 Jul 05 21:05:47.909399 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: Openstack-System-Scope: None Jul 05 21:05:47.909399 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: User-Agent: python-urllib3/1.26.9 Jul 05 21:05:47.909399 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Auth-Token: gAAAAABixKarHgq3GWxRAKGmFwqIOMVjxqRQFJ7-2_sqqMtaV9JHslnOGPoR_FnpEoGbLd0ulAIzNEyJKhgb_3l9UkX5Mn7TVDtn4GMWZ4xzhovIj2rt_z9oCnXCy_kxP3BJwmRcgYkKaWq3r03wWEMey-TXfn-Y_kpgbvCo-kJFjtitnsjsr2E Jul 05 21:05:47.909399 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Domain-Id: None Jul 05 21:05:47.909399 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Domain-Name: None Jul 05 21:05:47.909399 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Identity-Status: Confirmed Jul 05 21:05:47.909399 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Is-Admin-Project: True Jul 05 21:05:47.909399 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Project-Domain-Id: default Jul 05 21:05:47.909399 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Project-Domain-Name: Default Jul 05 21:05:47.909399 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Project-Id: e74557ea7f0f4057b190c0adaaa80ed9 Jul 05 21:05:47.909399 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Project-Name: tempest-AttachVolumeNegativeTest-1927644848 Jul 05 21:05:47.909399 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Role: member,reader Jul 05 21:05:47.909399 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Roles: member,reader Jul 05 21:05:47.911082 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e74557ea7f0f4057b190c0adaaa80ed9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/e74557ea7f0f4057b190c0adaaa80ed9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_e74557ea7f0f4057b190c0adaaa80ed9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e74557ea7f0f4057b190c0adaaa80ed9"}]}] Jul 05 21:05:47.911082 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Tenant: tempest-AttachVolumeNegativeTest-1927644848 Jul 05 21:05:47.911082 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Tenant-Id: e74557ea7f0f4057b190c0adaaa80ed9 Jul 05 21:05:47.911082 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1927644848 Jul 05 21:05:47.911082 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-User: tempest-AttachVolumeNegativeTest-1927644848-project Jul 05 21:05:47.911082 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-User-Domain-Id: default Jul 05 21:05:47.911082 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-User-Domain-Name: Default Jul 05 21:05:47.911082 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-User-Id: 0e12538a6dd44bdd963e9850c24c04bc Jul 05 21:05:47.911082 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-User-Name: tempest-AttachVolumeNegativeTest-1927644848-project Jul 05 21:05:47.911082 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: method: > Jul 05 21:05:47.911082 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: exception: Instance db7345ee-2fba-477b-8841-dc561c29e754 could not be found. Jul 05 21:05:47.911082 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: action_args: {'id': 'db7345ee-2fba-477b-8841-dc561c29e754'} Jul 05 21:05:47.911899 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 05 21:05:47.911899 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 21:05:47.911899 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 05 21:05:47.911899 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 05 21:05:47.911899 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 05 21:05:47.911899 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 05 21:05:47.911899 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 05 21:05:47.911899 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 05 21:05:47.911899 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 05 21:05:47.911899 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 05 21:05:47.911899 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance db7345ee-2fba-477b-8841-dc561c29e754 could not be found. Jul 05 21:05:47.911899 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi Jul 05 21:05:47.911899 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 21:05:47.911899 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi Jul 05 21:05:47.911899 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 21:05:47.911899 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 21:05:47.911899 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 21:05:47.911899 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 05 21:05:47.911899 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 05 21:05:47.911899 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 05 21:05:47.913290 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 05 21:05:47.913290 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 05 21:05:47.913290 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 05 21:05:47.913290 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 05 21:05:47.913290 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 05 21:05:47.913290 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 05 21:05:47.913290 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 05 21:05:47.913290 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 05 21:05:47.913290 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 05 21:05:47.913290 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance db7345ee-2fba-477b-8841-dc561c29e754 could not be found. Jul 05 21:05:47.913290 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi Jul 05 21:05:47.913290 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 21:05:47.913290 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi Jul 05 21:05:47.913290 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 21:05:47.913290 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 21:05:47.913290 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 21:05:47.913290 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 05 21:05:47.913290 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 05 21:05:47.913290 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance db7345ee-2fba-477b-8841-dc561c29e754 could not be found. Jul 05 21:05:47.913290 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi Jul 05 21:05:47.914673 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-056e3478-b69b-47f7-acf8-da17c7d0832e tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Returning 404 to user: Instance db7345ee-2fba-477b-8841-dc561c29e754 could not be found. {{(pid=117627) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 05 21:05:47.914673 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-056e3478-b69b-47f7-acf8-da17c7d0832e tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] 10.222.0.20 "DELETE /compute/v2.1/servers/db7345ee-2fba-477b-8841-dc561c29e754" status: 404 len: 111 microversion: 2.1 time: 0.031368 Jul 05 21:05:47.914673 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 455/932] 10.222.0.20 () {58 vars in 1238 bytes} [Tue Jul 5 21:05:47 2022] DELETE /compute/v2.1/servers/db7345ee-2fba-477b-8841-dc561c29e754 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 05 21:05:47.919089 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-8d0d3c78-b885-4b10-a6b9-12a7a54b75a8 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 21:05:47.919694 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-8d0d3c78-b885-4b10-a6b9-12a7a54b75a8 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] [instance: db7345ee-2fba-477b-8841-dc561c29e754] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 21:05:47.925766 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-8d0d3c78-b885-4b10-a6b9-12a7a54b75a8 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:05:47.926208 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-8d0d3c78-b885-4b10-a6b9-12a7a54b75a8 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:05:47.926955 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-8d0d3c78-b885-4b10-a6b9-12a7a54b75a8 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:05:47.927382 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-8d0d3c78-b885-4b10-a6b9-12a7a54b75a8 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:05:47.944126 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.wsgi [None req-8d0d3c78-b885-4b10-a6b9-12a7a54b75a8 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] HTTP exception thrown: Instance db7345ee-2fba-477b-8841-dc561c29e754 could not be found. Jul 05 21:05:47.945675 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-8d0d3c78-b885-4b10-a6b9-12a7a54b75a8 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Request method failure captured: Jul 05 21:05:47.945675 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: request: GET /compute/v2.1/servers/db7345ee-2fba-477b-8841-dc561c29e754 HTTP/1.1 Jul 05 21:05:47.945675 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: Accept: application/json Jul 05 21:05:47.945675 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: Accept-Encoding: identity Jul 05 21:05:47.945675 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: Connection: close Jul 05 21:05:47.945675 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: Content-Length: 0 Jul 05 21:05:47.945675 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: Content-Type: application/json Jul 05 21:05:47.945675 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: Host: 10.222.0.20 Jul 05 21:05:47.945675 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: Openstack-System-Scope: None Jul 05 21:05:47.945675 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: User-Agent: python-urllib3/1.26.9 Jul 05 21:05:47.945675 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Auth-Token: gAAAAABixKarHgq3GWxRAKGmFwqIOMVjxqRQFJ7-2_sqqMtaV9JHslnOGPoR_FnpEoGbLd0ulAIzNEyJKhgb_3l9UkX5Mn7TVDtn4GMWZ4xzhovIj2rt_z9oCnXCy_kxP3BJwmRcgYkKaWq3r03wWEMey-TXfn-Y_kpgbvCo-kJFjtitnsjsr2E Jul 05 21:05:47.945675 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Domain-Id: None Jul 05 21:05:47.945675 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Domain-Name: None Jul 05 21:05:47.945675 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Identity-Status: Confirmed Jul 05 21:05:47.945675 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Is-Admin-Project: True Jul 05 21:05:47.945675 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Project-Domain-Id: default Jul 05 21:05:47.945675 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Project-Domain-Name: Default Jul 05 21:05:47.945675 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Project-Id: e74557ea7f0f4057b190c0adaaa80ed9 Jul 05 21:05:47.945675 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Project-Name: tempest-AttachVolumeNegativeTest-1927644848 Jul 05 21:05:47.945675 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Role: member,reader Jul 05 21:05:47.945675 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Roles: member,reader Jul 05 21:05:47.948057 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e74557ea7f0f4057b190c0adaaa80ed9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/e74557ea7f0f4057b190c0adaaa80ed9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_e74557ea7f0f4057b190c0adaaa80ed9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e74557ea7f0f4057b190c0adaaa80ed9"}]}] Jul 05 21:05:47.948057 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Tenant: tempest-AttachVolumeNegativeTest-1927644848 Jul 05 21:05:47.948057 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Tenant-Id: e74557ea7f0f4057b190c0adaaa80ed9 Jul 05 21:05:47.948057 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1927644848 Jul 05 21:05:47.948057 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-User: tempest-AttachVolumeNegativeTest-1927644848-project Jul 05 21:05:47.948057 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-User-Domain-Id: default Jul 05 21:05:47.948057 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-User-Domain-Name: Default Jul 05 21:05:47.948057 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-User-Id: 0e12538a6dd44bdd963e9850c24c04bc Jul 05 21:05:47.948057 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-User-Name: tempest-AttachVolumeNegativeTest-1927644848-project Jul 05 21:05:47.948057 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: method: > Jul 05 21:05:47.948057 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: exception: Instance db7345ee-2fba-477b-8841-dc561c29e754 could not be found. Jul 05 21:05:47.948057 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: action_args: {'id': 'db7345ee-2fba-477b-8841-dc561c29e754'} Jul 05 21:05:47.948999 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 05 21:05:47.948999 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 21:05:47.948999 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 05 21:05:47.948999 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 05 21:05:47.948999 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 05 21:05:47.948999 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 05 21:05:47.948999 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 05 21:05:47.948999 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 05 21:05:47.948999 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 05 21:05:47.948999 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 05 21:05:47.948999 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance db7345ee-2fba-477b-8841-dc561c29e754 could not be found. Jul 05 21:05:47.948999 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi Jul 05 21:05:47.948999 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 21:05:47.948999 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi Jul 05 21:05:47.948999 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 21:05:47.948999 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 21:05:47.948999 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 21:05:47.948999 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 05 21:05:47.948999 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 05 21:05:47.948999 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 05 21:05:47.950673 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 05 21:05:47.950673 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 05 21:05:47.950673 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 05 21:05:47.950673 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 05 21:05:47.950673 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 05 21:05:47.950673 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 05 21:05:47.950673 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 05 21:05:47.950673 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance db7345ee-2fba-477b-8841-dc561c29e754 could not be found. Jul 05 21:05:47.950673 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi Jul 05 21:05:47.950673 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 21:05:47.950673 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi Jul 05 21:05:47.950673 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 21:05:47.950673 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 21:05:47.950673 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 21:05:47.950673 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 05 21:05:47.950673 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 05 21:05:47.950673 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance db7345ee-2fba-477b-8841-dc561c29e754 could not be found. Jul 05 21:05:47.950673 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi Jul 05 21:05:47.951911 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-8d0d3c78-b885-4b10-a6b9-12a7a54b75a8 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Returning 404 to user: Instance db7345ee-2fba-477b-8841-dc561c29e754 could not be found. {{(pid=117628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 05 21:05:47.951911 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-8d0d3c78-b885-4b10-a6b9-12a7a54b75a8 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] 10.222.0.20 "GET /compute/v2.1/servers/db7345ee-2fba-477b-8841-dc561c29e754" status: 404 len: 111 microversion: 2.1 time: 0.031873 Jul 05 21:05:47.951911 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 478/933] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 21:05:47 2022] GET /compute/v2.1/servers/db7345ee-2fba-477b-8841-dc561c29e754 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 05 21:05:49.079558 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-e781502d-6a20-46c7-8958-ab6619499a70 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 21:05:49.080090 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-e781502d-6a20-46c7-8958-ab6619499a70 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] [instance: 90cfd865-c450-453f-b03d-8c7e897ef805] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 21:05:49.086654 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-e781502d-6a20-46c7-8958-ab6619499a70 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:05:49.087103 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-e781502d-6a20-46c7-8958-ab6619499a70 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:05:49.087866 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-e781502d-6a20-46c7-8958-ab6619499a70 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:05:49.088307 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-e781502d-6a20-46c7-8958-ab6619499a70 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:05:49.101537 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.wsgi [None req-e781502d-6a20-46c7-8958-ab6619499a70 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] HTTP exception thrown: Instance 90cfd865-c450-453f-b03d-8c7e897ef805 could not be found. Jul 05 21:05:49.103056 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-e781502d-6a20-46c7-8958-ab6619499a70 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Request method failure captured: Jul 05 21:05:49.103056 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: request: DELETE /compute/v2.1/servers/90cfd865-c450-453f-b03d-8c7e897ef805 HTTP/1.1 Jul 05 21:05:49.103056 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: Accept: application/json Jul 05 21:05:49.103056 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: Accept-Encoding: identity Jul 05 21:05:49.103056 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: Connection: close Jul 05 21:05:49.103056 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: Content-Length: 0 Jul 05 21:05:49.103056 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: Content-Type: application/json Jul 05 21:05:49.103056 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: Host: 10.222.0.20 Jul 05 21:05:49.103056 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: Openstack-System-Scope: None Jul 05 21:05:49.103056 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: User-Agent: python-urllib3/1.26.9 Jul 05 21:05:49.103056 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Auth-Token: gAAAAABixKarHgq3GWxRAKGmFwqIOMVjxqRQFJ7-2_sqqMtaV9JHslnOGPoR_FnpEoGbLd0ulAIzNEyJKhgb_3l9UkX5Mn7TVDtn4GMWZ4xzhovIj2rt_z9oCnXCy_kxP3BJwmRcgYkKaWq3r03wWEMey-TXfn-Y_kpgbvCo-kJFjtitnsjsr2E Jul 05 21:05:49.103056 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Domain-Id: None Jul 05 21:05:49.103056 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Domain-Name: None Jul 05 21:05:49.103056 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Identity-Status: Confirmed Jul 05 21:05:49.103056 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Is-Admin-Project: True Jul 05 21:05:49.103056 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Project-Domain-Id: default Jul 05 21:05:49.103056 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Project-Domain-Name: Default Jul 05 21:05:49.103056 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Project-Id: e74557ea7f0f4057b190c0adaaa80ed9 Jul 05 21:05:49.103056 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Project-Name: tempest-AttachVolumeNegativeTest-1927644848 Jul 05 21:05:49.103056 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Role: member,reader Jul 05 21:05:49.103056 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Roles: member,reader Jul 05 21:05:49.105167 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e74557ea7f0f4057b190c0adaaa80ed9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/e74557ea7f0f4057b190c0adaaa80ed9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_e74557ea7f0f4057b190c0adaaa80ed9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e74557ea7f0f4057b190c0adaaa80ed9"}]}] Jul 05 21:05:49.105167 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Tenant: tempest-AttachVolumeNegativeTest-1927644848 Jul 05 21:05:49.105167 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Tenant-Id: e74557ea7f0f4057b190c0adaaa80ed9 Jul 05 21:05:49.105167 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1927644848 Jul 05 21:05:49.105167 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-User: tempest-AttachVolumeNegativeTest-1927644848-project Jul 05 21:05:49.105167 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-User-Domain-Id: default Jul 05 21:05:49.105167 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-User-Domain-Name: Default Jul 05 21:05:49.105167 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-User-Id: 0e12538a6dd44bdd963e9850c24c04bc Jul 05 21:05:49.105167 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-User-Name: tempest-AttachVolumeNegativeTest-1927644848-project Jul 05 21:05:49.105167 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: method: > Jul 05 21:05:49.105167 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: exception: Instance 90cfd865-c450-453f-b03d-8c7e897ef805 could not be found. Jul 05 21:05:49.105167 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: action_args: {'id': '90cfd865-c450-453f-b03d-8c7e897ef805'} Jul 05 21:05:49.106094 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 05 21:05:49.106094 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 21:05:49.106094 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 05 21:05:49.106094 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 05 21:05:49.106094 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 05 21:05:49.106094 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 05 21:05:49.106094 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 05 21:05:49.106094 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 05 21:05:49.106094 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 05 21:05:49.106094 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 05 21:05:49.106094 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 90cfd865-c450-453f-b03d-8c7e897ef805 could not be found. Jul 05 21:05:49.106094 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi Jul 05 21:05:49.106094 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 21:05:49.106094 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi Jul 05 21:05:49.106094 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 21:05:49.106094 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 21:05:49.106094 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 21:05:49.106094 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 05 21:05:49.106094 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 05 21:05:49.106094 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 05 21:05:49.107642 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 05 21:05:49.107642 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 05 21:05:49.107642 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 05 21:05:49.107642 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 05 21:05:49.107642 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 05 21:05:49.107642 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 05 21:05:49.107642 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 05 21:05:49.107642 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 05 21:05:49.107642 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 05 21:05:49.107642 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 90cfd865-c450-453f-b03d-8c7e897ef805 could not be found. Jul 05 21:05:49.107642 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi Jul 05 21:05:49.107642 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 21:05:49.107642 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi Jul 05 21:05:49.107642 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 21:05:49.107642 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 21:05:49.107642 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 21:05:49.107642 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 05 21:05:49.107642 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 05 21:05:49.107642 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 90cfd865-c450-453f-b03d-8c7e897ef805 could not be found. Jul 05 21:05:49.107642 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi Jul 05 21:05:49.109195 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-e781502d-6a20-46c7-8958-ab6619499a70 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Returning 404 to user: Instance 90cfd865-c450-453f-b03d-8c7e897ef805 could not be found. {{(pid=117627) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 05 21:05:49.109195 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-e781502d-6a20-46c7-8958-ab6619499a70 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] 10.222.0.20 "DELETE /compute/v2.1/servers/90cfd865-c450-453f-b03d-8c7e897ef805" status: 404 len: 111 microversion: 2.1 time: 0.029202 Jul 05 21:05:49.109195 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 456/934] 10.222.0.20 () {58 vars in 1238 bytes} [Tue Jul 5 21:05:49 2022] DELETE /compute/v2.1/servers/90cfd865-c450-453f-b03d-8c7e897ef805 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 05 21:05:49.113225 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-2e3f35f5-9cc5-4bec-9439-8ac1d8abd768 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 21:05:49.113842 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-2e3f35f5-9cc5-4bec-9439-8ac1d8abd768 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] [instance: 90cfd865-c450-453f-b03d-8c7e897ef805] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 21:05:49.121379 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-2e3f35f5-9cc5-4bec-9439-8ac1d8abd768 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:05:49.121828 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-2e3f35f5-9cc5-4bec-9439-8ac1d8abd768 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:05:49.122595 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-2e3f35f5-9cc5-4bec-9439-8ac1d8abd768 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:05:49.123034 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-2e3f35f5-9cc5-4bec-9439-8ac1d8abd768 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:05:49.136699 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.wsgi [None req-2e3f35f5-9cc5-4bec-9439-8ac1d8abd768 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] HTTP exception thrown: Instance 90cfd865-c450-453f-b03d-8c7e897ef805 could not be found. Jul 05 21:05:49.138271 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-2e3f35f5-9cc5-4bec-9439-8ac1d8abd768 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Request method failure captured: Jul 05 21:05:49.138271 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: request: GET /compute/v2.1/servers/90cfd865-c450-453f-b03d-8c7e897ef805 HTTP/1.1 Jul 05 21:05:49.138271 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: Accept: application/json Jul 05 21:05:49.138271 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: Accept-Encoding: identity Jul 05 21:05:49.138271 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: Connection: close Jul 05 21:05:49.138271 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: Content-Length: 0 Jul 05 21:05:49.138271 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: Content-Type: application/json Jul 05 21:05:49.138271 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: Host: 10.222.0.20 Jul 05 21:05:49.138271 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: Openstack-System-Scope: None Jul 05 21:05:49.138271 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: User-Agent: python-urllib3/1.26.9 Jul 05 21:05:49.138271 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Auth-Token: gAAAAABixKarHgq3GWxRAKGmFwqIOMVjxqRQFJ7-2_sqqMtaV9JHslnOGPoR_FnpEoGbLd0ulAIzNEyJKhgb_3l9UkX5Mn7TVDtn4GMWZ4xzhovIj2rt_z9oCnXCy_kxP3BJwmRcgYkKaWq3r03wWEMey-TXfn-Y_kpgbvCo-kJFjtitnsjsr2E Jul 05 21:05:49.138271 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Domain-Id: None Jul 05 21:05:49.138271 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Domain-Name: None Jul 05 21:05:49.138271 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Identity-Status: Confirmed Jul 05 21:05:49.138271 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Is-Admin-Project: True Jul 05 21:05:49.138271 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Project-Domain-Id: default Jul 05 21:05:49.138271 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Project-Domain-Name: Default Jul 05 21:05:49.138271 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Project-Id: e74557ea7f0f4057b190c0adaaa80ed9 Jul 05 21:05:49.138271 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Project-Name: tempest-AttachVolumeNegativeTest-1927644848 Jul 05 21:05:49.138271 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Role: member,reader Jul 05 21:05:49.138271 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Roles: member,reader Jul 05 21:05:49.139992 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e74557ea7f0f4057b190c0adaaa80ed9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/e74557ea7f0f4057b190c0adaaa80ed9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_e74557ea7f0f4057b190c0adaaa80ed9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e74557ea7f0f4057b190c0adaaa80ed9"}]}] Jul 05 21:05:49.139992 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Tenant: tempest-AttachVolumeNegativeTest-1927644848 Jul 05 21:05:49.139992 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Tenant-Id: e74557ea7f0f4057b190c0adaaa80ed9 Jul 05 21:05:49.139992 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1927644848 Jul 05 21:05:49.139992 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-User: tempest-AttachVolumeNegativeTest-1927644848-project Jul 05 21:05:49.139992 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-User-Domain-Id: default Jul 05 21:05:49.139992 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-User-Domain-Name: Default Jul 05 21:05:49.139992 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-User-Id: 0e12538a6dd44bdd963e9850c24c04bc Jul 05 21:05:49.139992 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-User-Name: tempest-AttachVolumeNegativeTest-1927644848-project Jul 05 21:05:49.139992 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: method: > Jul 05 21:05:49.139992 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: exception: Instance 90cfd865-c450-453f-b03d-8c7e897ef805 could not be found. Jul 05 21:05:49.139992 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: action_args: {'id': '90cfd865-c450-453f-b03d-8c7e897ef805'} Jul 05 21:05:49.141334 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 05 21:05:49.141334 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 21:05:49.141334 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 05 21:05:49.141334 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 05 21:05:49.141334 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 05 21:05:49.141334 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 05 21:05:49.141334 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 05 21:05:49.141334 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 05 21:05:49.141334 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 05 21:05:49.141334 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 05 21:05:49.141334 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 90cfd865-c450-453f-b03d-8c7e897ef805 could not be found. Jul 05 21:05:49.141334 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi Jul 05 21:05:49.141334 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 21:05:49.141334 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi Jul 05 21:05:49.141334 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 21:05:49.141334 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 21:05:49.141334 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 21:05:49.141334 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 05 21:05:49.141334 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 05 21:05:49.141334 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 05 21:05:49.142886 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 05 21:05:49.142886 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 05 21:05:49.142886 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 05 21:05:49.142886 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 05 21:05:49.142886 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 05 21:05:49.142886 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 05 21:05:49.142886 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 05 21:05:49.142886 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 90cfd865-c450-453f-b03d-8c7e897ef805 could not be found. Jul 05 21:05:49.142886 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi Jul 05 21:05:49.142886 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 21:05:49.142886 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi Jul 05 21:05:49.142886 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 21:05:49.142886 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 21:05:49.142886 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 21:05:49.142886 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 05 21:05:49.142886 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 05 21:05:49.142886 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 90cfd865-c450-453f-b03d-8c7e897ef805 could not be found. Jul 05 21:05:49.142886 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi Jul 05 21:05:49.144281 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-2e3f35f5-9cc5-4bec-9439-8ac1d8abd768 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] Returning 404 to user: Instance 90cfd865-c450-453f-b03d-8c7e897ef805 could not be found. {{(pid=117628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 05 21:05:49.144281 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-2e3f35f5-9cc5-4bec-9439-8ac1d8abd768 tempest-AttachVolumeNegativeTest-1927644848 tempest-AttachVolumeNegativeTest-1927644848-project] 10.222.0.20 "GET /compute/v2.1/servers/90cfd865-c450-453f-b03d-8c7e897ef805" status: 404 len: 111 microversion: 2.1 time: 0.030306 Jul 05 21:05:49.144281 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 479/935] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 21:05:49 2022] GET /compute/v2.1/servers/90cfd865-c450-453f-b03d-8c7e897ef805 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 05 21:06:31.732435 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-0a67f0d7-a16e-4095-b906-e47f661efa7c tempest-VolumesSnapshotTestJSON-579482592 tempest-VolumesSnapshotTestJSON-579482592-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1574511722", "imageRef": "88e08f49-c01d-4849-a89f-b678588e56f4", "flavorRef": "452", "networks": [{"uuid": "fa935307-8051-40ce-884c-2ea255ade2b4"}]}} {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 21:06:31.743160 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG dbcounter [-] [117627] Writing DB stats nova_api:SELECT=20 {{(pid=117627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:06:31.743808 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG dbcounter [-] [117627] Writing DB stats nova_cell1:SELECT=41,nova_cell1:INSERT=1 {{(pid=117627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:06:31.790273 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.network.neutron [None req-0a67f0d7-a16e-4095-b906-e47f661efa7c tempest-VolumesSnapshotTestJSON-579482592 tempest-VolumesSnapshotTestJSON-579482592-project] validate_networks() for [('fa935307-8051-40ce-884c-2ea255ade2b4', None, None, None, None, None)] {{(pid=117627) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 05 21:06:32.204979 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.virt.hardware [None req-0a67f0d7-a16e-4095-b906-e47f661efa7c tempest-VolumesSnapshotTestJSON-579482592 tempest-VolumesSnapshotTestJSON-579482592-project] Flavor limits 0:0:0 {{(pid=117627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 05 21:06:32.205551 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.virt.hardware [None req-0a67f0d7-a16e-4095-b906-e47f661efa7c tempest-VolumesSnapshotTestJSON-579482592 tempest-VolumesSnapshotTestJSON-579482592-project] Image limits 0:0:0 {{(pid=117627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 05 21:06:32.206020 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.virt.hardware [None req-0a67f0d7-a16e-4095-b906-e47f661efa7c tempest-VolumesSnapshotTestJSON-579482592 tempest-VolumesSnapshotTestJSON-579482592-project] Flavor pref 0:0:0 {{(pid=117627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 05 21:06:32.206418 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.virt.hardware [None req-0a67f0d7-a16e-4095-b906-e47f661efa7c tempest-VolumesSnapshotTestJSON-579482592 tempest-VolumesSnapshotTestJSON-579482592-project] Image pref 0:0:0 {{(pid=117627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 05 21:06:32.206820 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.virt.hardware [None req-0a67f0d7-a16e-4095-b906-e47f661efa7c tempest-VolumesSnapshotTestJSON-579482592 tempest-VolumesSnapshotTestJSON-579482592-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117627) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 05 21:06:32.216307 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-0a67f0d7-a16e-4095-b906-e47f661efa7c tempest-VolumesSnapshotTestJSON-579482592 tempest-VolumesSnapshotTestJSON-579482592-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:06:32.216742 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-0a67f0d7-a16e-4095-b906-e47f661efa7c tempest-VolumesSnapshotTestJSON-579482592 tempest-VolumesSnapshotTestJSON-579482592-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:06:32.217562 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-0a67f0d7-a16e-4095-b906-e47f661efa7c tempest-VolumesSnapshotTestJSON-579482592 tempest-VolumesSnapshotTestJSON-579482592-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:06:32.217987 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-0a67f0d7-a16e-4095-b906-e47f661efa7c tempest-VolumesSnapshotTestJSON-579482592 tempest-VolumesSnapshotTestJSON-579482592-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:06:32.235830 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.quota [None req-0a67f0d7-a16e-4095-b906-e47f661efa7c tempest-VolumesSnapshotTestJSON-579482592 tempest-VolumesSnapshotTestJSON-579482592-project] Getting quotas for project c4a4d189a97b441ea2790d04daa79853. Resources: {'cores', 'ram', 'instances'} {{(pid=117627) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 05 21:06:32.239800 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.quota [None req-0a67f0d7-a16e-4095-b906-e47f661efa7c tempest-VolumesSnapshotTestJSON-579482592 tempest-VolumesSnapshotTestJSON-579482592-project] Getting quotas for user 9538a349ca91455f818e1b9d7758f400 and project c4a4d189a97b441ea2790d04daa79853. Resources: {'cores', 'ram', 'instances'} {{(pid=117627) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 05 21:06:32.250655 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-0a67f0d7-a16e-4095-b906-e47f661efa7c tempest-VolumesSnapshotTestJSON-579482592 tempest-VolumesSnapshotTestJSON-579482592-project] Going to run 1 instances... {{(pid=117627) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 05 21:06:32.253032 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-0a67f0d7-a16e-4095-b906-e47f661efa7c tempest-VolumesSnapshotTestJSON-579482592 tempest-VolumesSnapshotTestJSON-579482592-project] [instance: 770a3b32-0743-4721-a8c8-61a4559ccbfa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='88e08f49-c01d-4849-a89f-b678588e56f4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117627) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 05 21:06:32.298225 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-0a67f0d7-a16e-4095-b906-e47f661efa7c tempest-VolumesSnapshotTestJSON-579482592 tempest-VolumesSnapshotTestJSON-579482592-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.572093 Jul 05 21:06:32.298868 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 457/936] 10.222.0.20 () {60 vars in 1146 bytes} [Tue Jul 5 21:06:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 574 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 05 21:06:32.309426 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-1de1abcd-8352-47e8-ba6c-a5e164f3e33f tempest-VolumesSnapshotTestJSON-579482592 tempest-VolumesSnapshotTestJSON-579482592-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 21:06:32.310040 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-1de1abcd-8352-47e8-ba6c-a5e164f3e33f tempest-VolumesSnapshotTestJSON-579482592 tempest-VolumesSnapshotTestJSON-579482592-project] [instance: 770a3b32-0743-4721-a8c8-61a4559ccbfa] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 21:06:32.312431 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG dbcounter [-] [117628] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=117628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:06:32.313243 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG dbcounter [-] [117628] Writing DB stats nova_cell1:SELECT=47,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:06:32.371481 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-1de1abcd-8352-47e8-ba6c-a5e164f3e33f tempest-VolumesSnapshotTestJSON-579482592 tempest-VolumesSnapshotTestJSON-579482592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9538a349ca91455f818e1b9d7758f400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a4d189a97b441ea2790d04daa79853', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 21:06:32.378468 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-1de1abcd-8352-47e8-ba6c-a5e164f3e33f tempest-VolumesSnapshotTestJSON-579482592 tempest-VolumesSnapshotTestJSON-579482592-project] 10.222.0.20 "GET /compute/v2.1/servers/770a3b32-0743-4721-a8c8-61a4559ccbfa" status: 200 len: 1219 microversion: 2.1 time: 0.073611 Jul 05 21:06:32.379055 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 480/937] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 21:06:32 2022] GET /compute/v2.1/servers/770a3b32-0743-4721-a8c8-61a4559ccbfa => generated 1219 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 21:06:33.396258 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-834c12da-42db-441e-9fb6-36ea44da43c1 tempest-VolumesSnapshotTestJSON-579482592 tempest-VolumesSnapshotTestJSON-579482592-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 21:06:33.396868 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-834c12da-42db-441e-9fb6-36ea44da43c1 tempest-VolumesSnapshotTestJSON-579482592 tempest-VolumesSnapshotTestJSON-579482592-project] [instance: 770a3b32-0743-4721-a8c8-61a4559ccbfa] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 21:06:33.403785 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-834c12da-42db-441e-9fb6-36ea44da43c1 tempest-VolumesSnapshotTestJSON-579482592 tempest-VolumesSnapshotTestJSON-579482592-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:06:33.404229 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-834c12da-42db-441e-9fb6-36ea44da43c1 tempest-VolumesSnapshotTestJSON-579482592 tempest-VolumesSnapshotTestJSON-579482592-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:06:33.405024 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-834c12da-42db-441e-9fb6-36ea44da43c1 tempest-VolumesSnapshotTestJSON-579482592 tempest-VolumesSnapshotTestJSON-579482592-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:06:33.405460 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-834c12da-42db-441e-9fb6-36ea44da43c1 tempest-VolumesSnapshotTestJSON-579482592 tempest-VolumesSnapshotTestJSON-579482592-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:06:33.476637 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-834c12da-42db-441e-9fb6-36ea44da43c1 tempest-VolumesSnapshotTestJSON-579482592 tempest-VolumesSnapshotTestJSON-579482592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9538a349ca91455f818e1b9d7758f400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a4d189a97b441ea2790d04daa79853', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 21:06:33.484596 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-834c12da-42db-441e-9fb6-36ea44da43c1 tempest-VolumesSnapshotTestJSON-579482592 tempest-VolumesSnapshotTestJSON-579482592-project] 10.222.0.20 "GET /compute/v2.1/servers/770a3b32-0743-4721-a8c8-61a4559ccbfa" status: 200 len: 1277 microversion: 2.1 time: 0.092836 Jul 05 21:06:33.485188 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 458/938] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 21:06:33 2022] GET /compute/v2.1/servers/770a3b32-0743-4721-a8c8-61a4559ccbfa => generated 1277 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 21:06:34.502855 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-83f3fd09-cb55-488a-9381-341891a57bd8 tempest-VolumesSnapshotTestJSON-579482592 tempest-VolumesSnapshotTestJSON-579482592-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 21:06:34.503567 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-83f3fd09-cb55-488a-9381-341891a57bd8 tempest-VolumesSnapshotTestJSON-579482592 tempest-VolumesSnapshotTestJSON-579482592-project] [instance: 770a3b32-0743-4721-a8c8-61a4559ccbfa] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 21:06:34.513518 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-83f3fd09-cb55-488a-9381-341891a57bd8 tempest-VolumesSnapshotTestJSON-579482592 tempest-VolumesSnapshotTestJSON-579482592-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:06:34.513976 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-83f3fd09-cb55-488a-9381-341891a57bd8 tempest-VolumesSnapshotTestJSON-579482592 tempest-VolumesSnapshotTestJSON-579482592-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:06:34.514752 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-83f3fd09-cb55-488a-9381-341891a57bd8 tempest-VolumesSnapshotTestJSON-579482592 tempest-VolumesSnapshotTestJSON-579482592-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:06:34.515367 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-83f3fd09-cb55-488a-9381-341891a57bd8 tempest-VolumesSnapshotTestJSON-579482592 tempest-VolumesSnapshotTestJSON-579482592-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:06:34.520425 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [req-441933ff-6580-442a-9340-dfbd969792e7 req-181bd8dd-188d-4ccd-9b29-9fd8fecf39d5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "770a3b32-0743-4721-a8c8-61a4559ccbfa", "tag": "3e4e3b56-35b6-4447-b6e2-14fa70ffa3c6"}]} {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 21:06:34.530999 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [req-441933ff-6580-442a-9340-dfbd969792e7 req-181bd8dd-188d-4ccd-9b29-9fd8fecf39d5 service nova] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:06:34.531992 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [req-441933ff-6580-442a-9340-dfbd969792e7 req-181bd8dd-188d-4ccd-9b29-9fd8fecf39d5 service nova] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:06:34.545378 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.compute.server_external_events [req-441933ff-6580-442a-9340-dfbd969792e7 req-181bd8dd-188d-4ccd-9b29-9fd8fecf39d5 service nova] Creating event network-changed:3e4e3b56-35b6-4447-b6e2-14fa70ffa3c6 for instance 770a3b32-0743-4721-a8c8-61a4559ccbfa on hv-cinder-79760 Jul 05 21:06:34.550294 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [req-441933ff-6580-442a-9340-dfbd969792e7 req-181bd8dd-188d-4ccd-9b29-9fd8fecf39d5 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034033 Jul 05 21:06:34.551058 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 459/939] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 5 21:06:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 21:06:34.740817 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-83f3fd09-cb55-488a-9381-341891a57bd8 tempest-VolumesSnapshotTestJSON-579482592 tempest-VolumesSnapshotTestJSON-579482592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9538a349ca91455f818e1b9d7758f400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a4d189a97b441ea2790d04daa79853', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 21:06:34.748677 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-83f3fd09-cb55-488a-9381-341891a57bd8 tempest-VolumesSnapshotTestJSON-579482592 tempest-VolumesSnapshotTestJSON-579482592-project] 10.222.0.20 "GET /compute/v2.1/servers/770a3b32-0743-4721-a8c8-61a4559ccbfa" status: 200 len: 1319 microversion: 2.1 time: 0.250877 Jul 05 21:06:34.749465 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 481/940] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 21:06:34 2022] GET /compute/v2.1/servers/770a3b32-0743-4721-a8c8-61a4559ccbfa => generated 1319 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 21:06:35.769557 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-85366309-7928-4214-9547-88e2bd7608f4 tempest-VolumesSnapshotTestJSON-579482592 tempest-VolumesSnapshotTestJSON-579482592-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 21:06:35.770251 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-85366309-7928-4214-9547-88e2bd7608f4 tempest-VolumesSnapshotTestJSON-579482592 tempest-VolumesSnapshotTestJSON-579482592-project] [instance: 770a3b32-0743-4721-a8c8-61a4559ccbfa] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 21:06:35.778834 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-85366309-7928-4214-9547-88e2bd7608f4 tempest-VolumesSnapshotTestJSON-579482592 tempest-VolumesSnapshotTestJSON-579482592-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:06:35.779636 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-85366309-7928-4214-9547-88e2bd7608f4 tempest-VolumesSnapshotTestJSON-579482592 tempest-VolumesSnapshotTestJSON-579482592-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:06:35.780812 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-85366309-7928-4214-9547-88e2bd7608f4 tempest-VolumesSnapshotTestJSON-579482592 tempest-VolumesSnapshotTestJSON-579482592-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:06:35.781276 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-85366309-7928-4214-9547-88e2bd7608f4 tempest-VolumesSnapshotTestJSON-579482592 tempest-VolumesSnapshotTestJSON-579482592-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:06:35.994305 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-85366309-7928-4214-9547-88e2bd7608f4 tempest-VolumesSnapshotTestJSON-579482592 tempest-VolumesSnapshotTestJSON-579482592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9538a349ca91455f818e1b9d7758f400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a4d189a97b441ea2790d04daa79853', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 21:06:36.001857 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-85366309-7928-4214-9547-88e2bd7608f4 tempest-VolumesSnapshotTestJSON-579482592 tempest-VolumesSnapshotTestJSON-579482592-project] 10.222.0.20 "GET /compute/v2.1/servers/770a3b32-0743-4721-a8c8-61a4559ccbfa" status: 200 len: 1319 microversion: 2.1 time: 0.236727 Jul 05 21:06:36.002412 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 460/941] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 21:06:35 2022] GET /compute/v2.1/servers/770a3b32-0743-4721-a8c8-61a4559ccbfa => generated 1319 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 21:06:37.019728 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-8b673f99-dcec-45fe-890f-bb1a659e57d6 tempest-VolumesSnapshotTestJSON-579482592 tempest-VolumesSnapshotTestJSON-579482592-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 21:06:37.020287 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-8b673f99-dcec-45fe-890f-bb1a659e57d6 tempest-VolumesSnapshotTestJSON-579482592 tempest-VolumesSnapshotTestJSON-579482592-project] [instance: 770a3b32-0743-4721-a8c8-61a4559ccbfa] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 21:06:37.027291 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-8b673f99-dcec-45fe-890f-bb1a659e57d6 tempest-VolumesSnapshotTestJSON-579482592 tempest-VolumesSnapshotTestJSON-579482592-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:06:37.027736 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-8b673f99-dcec-45fe-890f-bb1a659e57d6 tempest-VolumesSnapshotTestJSON-579482592 tempest-VolumesSnapshotTestJSON-579482592-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:06:37.028507 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-8b673f99-dcec-45fe-890f-bb1a659e57d6 tempest-VolumesSnapshotTestJSON-579482592 tempest-VolumesSnapshotTestJSON-579482592-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:06:37.028949 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-8b673f99-dcec-45fe-890f-bb1a659e57d6 tempest-VolumesSnapshotTestJSON-579482592 tempest-VolumesSnapshotTestJSON-579482592-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:06:37.157778 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-8b673f99-dcec-45fe-890f-bb1a659e57d6 tempest-VolumesSnapshotTestJSON-579482592 tempest-VolumesSnapshotTestJSON-579482592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9538a349ca91455f818e1b9d7758f400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a4d189a97b441ea2790d04daa79853', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 21:06:37.165163 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-8b673f99-dcec-45fe-890f-bb1a659e57d6 tempest-VolumesSnapshotTestJSON-579482592 tempest-VolumesSnapshotTestJSON-579482592-project] 10.222.0.20 "GET /compute/v2.1/servers/770a3b32-0743-4721-a8c8-61a4559ccbfa" status: 200 len: 1319 microversion: 2.1 time: 0.149653 Jul 05 21:06:37.166258 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 482/942] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 21:06:37 2022] GET /compute/v2.1/servers/770a3b32-0743-4721-a8c8-61a4559ccbfa => generated 1319 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 21:06:38.182385 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-60079747-1ded-43cd-876b-2484ae227a76 tempest-VolumesSnapshotTestJSON-579482592 tempest-VolumesSnapshotTestJSON-579482592-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 21:06:38.182984 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-60079747-1ded-43cd-876b-2484ae227a76 tempest-VolumesSnapshotTestJSON-579482592 tempest-VolumesSnapshotTestJSON-579482592-project] [instance: 770a3b32-0743-4721-a8c8-61a4559ccbfa] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 21:06:38.189393 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-60079747-1ded-43cd-876b-2484ae227a76 tempest-VolumesSnapshotTestJSON-579482592 tempest-VolumesSnapshotTestJSON-579482592-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:06:38.189834 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-60079747-1ded-43cd-876b-2484ae227a76 tempest-VolumesSnapshotTestJSON-579482592 tempest-VolumesSnapshotTestJSON-579482592-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:06:38.190587 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-60079747-1ded-43cd-876b-2484ae227a76 tempest-VolumesSnapshotTestJSON-579482592 tempest-VolumesSnapshotTestJSON-579482592-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:06:38.191013 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-60079747-1ded-43cd-876b-2484ae227a76 tempest-VolumesSnapshotTestJSON-579482592 tempest-VolumesSnapshotTestJSON-579482592-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:06:38.320486 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-60079747-1ded-43cd-876b-2484ae227a76 tempest-VolumesSnapshotTestJSON-579482592 tempest-VolumesSnapshotTestJSON-579482592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9538a349ca91455f818e1b9d7758f400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a4d189a97b441ea2790d04daa79853', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 21:06:38.327887 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-60079747-1ded-43cd-876b-2484ae227a76 tempest-VolumesSnapshotTestJSON-579482592 tempest-VolumesSnapshotTestJSON-579482592-project] 10.222.0.20 "GET /compute/v2.1/servers/770a3b32-0743-4721-a8c8-61a4559ccbfa" status: 200 len: 1319 microversion: 2.1 time: 0.149346 Jul 05 21:06:38.328446 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 461/943] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 21:06:38 2022] GET /compute/v2.1/servers/770a3b32-0743-4721-a8c8-61a4559ccbfa => generated 1319 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 21:06:39.344539 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-33eace56-34dc-4493-bb49-650db0f4eabb tempest-VolumesSnapshotTestJSON-579482592 tempest-VolumesSnapshotTestJSON-579482592-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 21:06:39.345188 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-33eace56-34dc-4493-bb49-650db0f4eabb tempest-VolumesSnapshotTestJSON-579482592 tempest-VolumesSnapshotTestJSON-579482592-project] [instance: 770a3b32-0743-4721-a8c8-61a4559ccbfa] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 21:06:39.351633 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-33eace56-34dc-4493-bb49-650db0f4eabb tempest-VolumesSnapshotTestJSON-579482592 tempest-VolumesSnapshotTestJSON-579482592-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:06:39.352080 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-33eace56-34dc-4493-bb49-650db0f4eabb tempest-VolumesSnapshotTestJSON-579482592 tempest-VolumesSnapshotTestJSON-579482592-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:06:39.352867 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-33eace56-34dc-4493-bb49-650db0f4eabb tempest-VolumesSnapshotTestJSON-579482592 tempest-VolumesSnapshotTestJSON-579482592-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:06:39.353853 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-33eace56-34dc-4493-bb49-650db0f4eabb tempest-VolumesSnapshotTestJSON-579482592 tempest-VolumesSnapshotTestJSON-579482592-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:06:39.483807 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-33eace56-34dc-4493-bb49-650db0f4eabb tempest-VolumesSnapshotTestJSON-579482592 tempest-VolumesSnapshotTestJSON-579482592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9538a349ca91455f818e1b9d7758f400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a4d189a97b441ea2790d04daa79853', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 21:06:39.491113 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-33eace56-34dc-4493-bb49-650db0f4eabb tempest-VolumesSnapshotTestJSON-579482592 tempest-VolumesSnapshotTestJSON-579482592-project] 10.222.0.20 "GET /compute/v2.1/servers/770a3b32-0743-4721-a8c8-61a4559ccbfa" status: 200 len: 1319 microversion: 2.1 time: 0.150502 Jul 05 21:06:39.491670 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 483/944] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 21:06:39 2022] GET /compute/v2.1/servers/770a3b32-0743-4721-a8c8-61a4559ccbfa => generated 1319 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 21:06:39.844440 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [req-d915308a-f517-4fbc-9673-058bebe945eb req-8c0fe2ca-5c76-43ad-a640-aacece92347b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "770a3b32-0743-4721-a8c8-61a4559ccbfa", "name": "network-vif-plugged", "status": "completed", "tag": "3e4e3b56-35b6-4447-b6e2-14fa70ffa3c6"}]} {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 21:06:39.852481 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [req-d915308a-f517-4fbc-9673-058bebe945eb req-8c0fe2ca-5c76-43ad-a640-aacece92347b service nova] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:06:39.852862 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [req-d915308a-f517-4fbc-9673-058bebe945eb req-8c0fe2ca-5c76-43ad-a640-aacece92347b service nova] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:06:39.863821 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.compute.server_external_events [req-d915308a-f517-4fbc-9673-058bebe945eb req-8c0fe2ca-5c76-43ad-a640-aacece92347b service nova] Creating event network-vif-plugged:3e4e3b56-35b6-4447-b6e2-14fa70ffa3c6 for instance 770a3b32-0743-4721-a8c8-61a4559ccbfa on hv-cinder-79760 Jul 05 21:06:39.868473 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [req-d915308a-f517-4fbc-9673-058bebe945eb req-8c0fe2ca-5c76-43ad-a640-aacece92347b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.149715 Jul 05 21:06:39.869638 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 462/945] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 5 21:06:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 21:06:40.507159 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-eb5da31c-b48b-4a83-bbaa-811ac4927d4c tempest-VolumesSnapshotTestJSON-579482592 tempest-VolumesSnapshotTestJSON-579482592-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 21:06:40.507701 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-eb5da31c-b48b-4a83-bbaa-811ac4927d4c tempest-VolumesSnapshotTestJSON-579482592 tempest-VolumesSnapshotTestJSON-579482592-project] [instance: 770a3b32-0743-4721-a8c8-61a4559ccbfa] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 21:06:40.514739 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-eb5da31c-b48b-4a83-bbaa-811ac4927d4c tempest-VolumesSnapshotTestJSON-579482592 tempest-VolumesSnapshotTestJSON-579482592-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:06:40.515177 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-eb5da31c-b48b-4a83-bbaa-811ac4927d4c tempest-VolumesSnapshotTestJSON-579482592 tempest-VolumesSnapshotTestJSON-579482592-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:06:40.515926 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-eb5da31c-b48b-4a83-bbaa-811ac4927d4c tempest-VolumesSnapshotTestJSON-579482592 tempest-VolumesSnapshotTestJSON-579482592-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:06:40.516352 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-eb5da31c-b48b-4a83-bbaa-811ac4927d4c tempest-VolumesSnapshotTestJSON-579482592 tempest-VolumesSnapshotTestJSON-579482592-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:06:40.647455 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-eb5da31c-b48b-4a83-bbaa-811ac4927d4c tempest-VolumesSnapshotTestJSON-579482592 tempest-VolumesSnapshotTestJSON-579482592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9538a349ca91455f818e1b9d7758f400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a4d189a97b441ea2790d04daa79853', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 21:06:40.654839 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-eb5da31c-b48b-4a83-bbaa-811ac4927d4c tempest-VolumesSnapshotTestJSON-579482592 tempest-VolumesSnapshotTestJSON-579482592-project] 10.222.0.20 "GET /compute/v2.1/servers/770a3b32-0743-4721-a8c8-61a4559ccbfa" status: 200 len: 1319 microversion: 2.1 time: 0.151672 Jul 05 21:06:40.655394 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 484/946] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 21:06:40 2022] GET /compute/v2.1/servers/770a3b32-0743-4721-a8c8-61a4559ccbfa => generated 1319 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 21:06:41.673053 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-3587b763-71bc-4d88-b5c1-cc72d3fa0287 tempest-VolumesSnapshotTestJSON-579482592 tempest-VolumesSnapshotTestJSON-579482592-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 21:06:41.673743 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-3587b763-71bc-4d88-b5c1-cc72d3fa0287 tempest-VolumesSnapshotTestJSON-579482592 tempest-VolumesSnapshotTestJSON-579482592-project] [instance: 770a3b32-0743-4721-a8c8-61a4559ccbfa] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 21:06:41.679939 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-3587b763-71bc-4d88-b5c1-cc72d3fa0287 tempest-VolumesSnapshotTestJSON-579482592 tempest-VolumesSnapshotTestJSON-579482592-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:06:41.680385 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-3587b763-71bc-4d88-b5c1-cc72d3fa0287 tempest-VolumesSnapshotTestJSON-579482592 tempest-VolumesSnapshotTestJSON-579482592-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:06:41.681168 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-3587b763-71bc-4d88-b5c1-cc72d3fa0287 tempest-VolumesSnapshotTestJSON-579482592 tempest-VolumesSnapshotTestJSON-579482592-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:06:41.681663 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-3587b763-71bc-4d88-b5c1-cc72d3fa0287 tempest-VolumesSnapshotTestJSON-579482592 tempest-VolumesSnapshotTestJSON-579482592-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:06:41.811543 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-3587b763-71bc-4d88-b5c1-cc72d3fa0287 tempest-VolumesSnapshotTestJSON-579482592 tempest-VolumesSnapshotTestJSON-579482592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9538a349ca91455f818e1b9d7758f400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a4d189a97b441ea2790d04daa79853', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 21:06:41.818908 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-3587b763-71bc-4d88-b5c1-cc72d3fa0287 tempest-VolumesSnapshotTestJSON-579482592 tempest-VolumesSnapshotTestJSON-579482592-project] 10.222.0.20 "GET /compute/v2.1/servers/770a3b32-0743-4721-a8c8-61a4559ccbfa" status: 200 len: 1506 microversion: 2.1 time: 0.150536 Jul 05 21:06:41.819463 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 463/947] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 21:06:41 2022] GET /compute/v2.1/servers/770a3b32-0743-4721-a8c8-61a4559ccbfa => generated 1506 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 21:06:56.049324 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-1bc461a5-4cfa-466d-ac0e-c70d4723625d tempest-VolumesSnapshotTestJSON-579482592 tempest-VolumesSnapshotTestJSON-579482592-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "882c43f4-d837-4e3d-812a-cca6ef29e999", "device": "/dev/sdb"}} {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 21:06:56.050918 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-1bc461a5-4cfa-466d-ac0e-c70d4723625d tempest-VolumesSnapshotTestJSON-579482592 tempest-VolumesSnapshotTestJSON-579482592-project] [instance: 770a3b32-0743-4721-a8c8-61a4559ccbfa] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 21:06:56.053070 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG dbcounter [-] [117628] Writing DB stats nova_cell0:SELECT=2 {{(pid=117628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:06:56.053829 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG dbcounter [-] [117628] Writing DB stats nova_api:SELECT=12 {{(pid=117628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:06:56.054395 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG dbcounter [-] [117628] Writing DB stats nova_cell1:SELECT=24 {{(pid=117628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:06:56.062030 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-1bc461a5-4cfa-466d-ac0e-c70d4723625d tempest-VolumesSnapshotTestJSON-579482592 tempest-VolumesSnapshotTestJSON-579482592-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:06:56.062479 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-1bc461a5-4cfa-466d-ac0e-c70d4723625d tempest-VolumesSnapshotTestJSON-579482592 tempest-VolumesSnapshotTestJSON-579482592-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:06:56.063245 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-1bc461a5-4cfa-466d-ac0e-c70d4723625d tempest-VolumesSnapshotTestJSON-579482592 tempest-VolumesSnapshotTestJSON-579482592-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:06:56.063683 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-1bc461a5-4cfa-466d-ac0e-c70d4723625d tempest-VolumesSnapshotTestJSON-579482592 tempest-VolumesSnapshotTestJSON-579482592-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:06:56.308215 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-1bc461a5-4cfa-466d-ac0e-c70d4723625d tempest-VolumesSnapshotTestJSON-579482592 tempest-VolumesSnapshotTestJSON-579482592-project] 10.222.0.20 "POST /compute/v2.1/servers/770a3b32-0743-4721-a8c8-61a4559ccbfa/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.262543 Jul 05 21:06:56.308810 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 485/948] 10.222.0.20 () {60 vars in 1322 bytes} [Tue Jul 5 21:06:56 2022] POST /compute/v2.1/servers/770a3b32-0743-4721-a8c8-61a4559ccbfa/os-volume_attachments => generated 194 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 21:07:16.854953 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-8c277d18-dd1b-4c82-8815-6625249d3cf4 tempest-VolumesSnapshotTestJSON-579482592 tempest-VolumesSnapshotTestJSON-579482592-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 21:07:16.855463 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-8c277d18-dd1b-4c82-8815-6625249d3cf4 tempest-VolumesSnapshotTestJSON-579482592 tempest-VolumesSnapshotTestJSON-579482592-project] [instance: 770a3b32-0743-4721-a8c8-61a4559ccbfa] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 21:07:16.857549 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG dbcounter [-] [117627] Writing DB stats nova_cell0:SELECT=2 {{(pid=117627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:07:16.858187 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG dbcounter [-] [117627] Writing DB stats nova_cell0:SELECT=6 {{(pid=117627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:07:16.859039 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG dbcounter [-] [117627] Writing DB stats nova_api:SELECT=25,nova_api:INSERT=3 {{(pid=117627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:07:16.859652 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG dbcounter [-] [117627] Writing DB stats nova_cell1:SELECT=30 {{(pid=117627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:07:16.866547 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-8c277d18-dd1b-4c82-8815-6625249d3cf4 tempest-VolumesSnapshotTestJSON-579482592 tempest-VolumesSnapshotTestJSON-579482592-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:07:16.867006 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-8c277d18-dd1b-4c82-8815-6625249d3cf4 tempest-VolumesSnapshotTestJSON-579482592 tempest-VolumesSnapshotTestJSON-579482592-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:07:16.867737 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-8c277d18-dd1b-4c82-8815-6625249d3cf4 tempest-VolumesSnapshotTestJSON-579482592 tempest-VolumesSnapshotTestJSON-579482592-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:07:16.868198 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-8c277d18-dd1b-4c82-8815-6625249d3cf4 tempest-VolumesSnapshotTestJSON-579482592 tempest-VolumesSnapshotTestJSON-579482592-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:07:16.951046 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.objects.instance [None req-8c277d18-dd1b-4c82-8815-6625249d3cf4 tempest-VolumesSnapshotTestJSON-579482592 tempest-VolumesSnapshotTestJSON-579482592-project] Lazy-loading 'services' on Instance uuid 770a3b32-0743-4721-a8c8-61a4559ccbfa {{(pid=117627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 05 21:07:17.023708 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-8c277d18-dd1b-4c82-8815-6625249d3cf4 tempest-VolumesSnapshotTestJSON-579482592 tempest-VolumesSnapshotTestJSON-579482592-project] 10.222.0.20 "DELETE /compute/v2.1/servers/770a3b32-0743-4721-a8c8-61a4559ccbfa/os-volume_attachments/882c43f4-d837-4e3d-812a-cca6ef29e999" status: 202 len: 0 microversion: 2.1 time: 0.172988 Jul 05 21:07:17.024208 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 464/949] 10.222.0.20 () {58 vars in 1415 bytes} [Tue Jul 5 21:07:16 2022] DELETE /compute/v2.1/servers/770a3b32-0743-4721-a8c8-61a4559ccbfa/os-volume_attachments/882c43f4-d837-4e3d-812a-cca6ef29e999 => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 05 21:07:18.136751 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG dbcounter [-] [117628] Writing DB stats nova_api:SELECT=2 {{(pid=117628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:07:18.137539 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG dbcounter [-] [117628] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:07:18.141473 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-3fb22192-bc4c-4ba3-9549-a606f8d29b32 tempest-VolumesSnapshotTestJSON-579482592 tempest-VolumesSnapshotTestJSON-579482592-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 21:07:18.142049 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-3fb22192-bc4c-4ba3-9549-a606f8d29b32 tempest-VolumesSnapshotTestJSON-579482592 tempest-VolumesSnapshotTestJSON-579482592-project] [instance: 770a3b32-0743-4721-a8c8-61a4559ccbfa] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 21:07:18.149484 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-3fb22192-bc4c-4ba3-9549-a606f8d29b32 tempest-VolumesSnapshotTestJSON-579482592 tempest-VolumesSnapshotTestJSON-579482592-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:07:18.150031 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-3fb22192-bc4c-4ba3-9549-a606f8d29b32 tempest-VolumesSnapshotTestJSON-579482592 tempest-VolumesSnapshotTestJSON-579482592-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:07:18.150843 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-3fb22192-bc4c-4ba3-9549-a606f8d29b32 tempest-VolumesSnapshotTestJSON-579482592 tempest-VolumesSnapshotTestJSON-579482592-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:07:18.151271 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-3fb22192-bc4c-4ba3-9549-a606f8d29b32 tempest-VolumesSnapshotTestJSON-579482592 tempest-VolumesSnapshotTestJSON-579482592-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:07:18.176473 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-3fb22192-bc4c-4ba3-9549-a606f8d29b32 tempest-VolumesSnapshotTestJSON-579482592 tempest-VolumesSnapshotTestJSON-579482592-project] [instance: 770a3b32-0743-4721-a8c8-61a4559ccbfa] Going to try to terminate instance {{(pid=117628) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 05 21:07:18.249868 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-3fb22192-bc4c-4ba3-9549-a606f8d29b32 tempest-VolumesSnapshotTestJSON-579482592 tempest-VolumesSnapshotTestJSON-579482592-project] 10.222.0.20 "DELETE /compute/v2.1/servers/770a3b32-0743-4721-a8c8-61a4559ccbfa" status: 204 len: 0 microversion: 2.1 time: 0.114276 Jul 05 21:07:18.250632 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 486/950] 10.222.0.20 () {58 vars in 1238 bytes} [Tue Jul 5 21:07:18 2022] DELETE /compute/v2.1/servers/770a3b32-0743-4721-a8c8-61a4559ccbfa => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 05 21:07:18.259770 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-d69b47d4-46c1-473f-a6ad-f15d19d26bff tempest-VolumesSnapshotTestJSON-579482592 tempest-VolumesSnapshotTestJSON-579482592-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 21:07:18.260578 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-d69b47d4-46c1-473f-a6ad-f15d19d26bff tempest-VolumesSnapshotTestJSON-579482592 tempest-VolumesSnapshotTestJSON-579482592-project] [instance: 770a3b32-0743-4721-a8c8-61a4559ccbfa] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 21:07:18.266873 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-d69b47d4-46c1-473f-a6ad-f15d19d26bff tempest-VolumesSnapshotTestJSON-579482592 tempest-VolumesSnapshotTestJSON-579482592-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:07:18.267320 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-d69b47d4-46c1-473f-a6ad-f15d19d26bff tempest-VolumesSnapshotTestJSON-579482592 tempest-VolumesSnapshotTestJSON-579482592-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:07:18.268343 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-d69b47d4-46c1-473f-a6ad-f15d19d26bff tempest-VolumesSnapshotTestJSON-579482592 tempest-VolumesSnapshotTestJSON-579482592-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:07:18.269001 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-d69b47d4-46c1-473f-a6ad-f15d19d26bff tempest-VolumesSnapshotTestJSON-579482592 tempest-VolumesSnapshotTestJSON-579482592-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:07:18.407051 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-d69b47d4-46c1-473f-a6ad-f15d19d26bff tempest-VolumesSnapshotTestJSON-579482592 tempest-VolumesSnapshotTestJSON-579482592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9538a349ca91455f818e1b9d7758f400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a4d189a97b441ea2790d04daa79853', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 21:07:18.414530 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-d69b47d4-46c1-473f-a6ad-f15d19d26bff tempest-VolumesSnapshotTestJSON-579482592 tempest-VolumesSnapshotTestJSON-579482592-project] 10.222.0.20 "GET /compute/v2.1/servers/770a3b32-0743-4721-a8c8-61a4559ccbfa" status: 200 len: 1512 microversion: 2.1 time: 0.159590 Jul 05 21:07:18.415086 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 465/951] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 21:07:18 2022] GET /compute/v2.1/servers/770a3b32-0743-4721-a8c8-61a4559ccbfa => generated 1512 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 21:07:19.433080 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-fb122c79-5f02-4b5a-8b07-8e58089c07cc tempest-VolumesSnapshotTestJSON-579482592 tempest-VolumesSnapshotTestJSON-579482592-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 21:07:19.433774 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-fb122c79-5f02-4b5a-8b07-8e58089c07cc tempest-VolumesSnapshotTestJSON-579482592 tempest-VolumesSnapshotTestJSON-579482592-project] [instance: 770a3b32-0743-4721-a8c8-61a4559ccbfa] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 21:07:19.440108 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-fb122c79-5f02-4b5a-8b07-8e58089c07cc tempest-VolumesSnapshotTestJSON-579482592 tempest-VolumesSnapshotTestJSON-579482592-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:07:19.440548 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-fb122c79-5f02-4b5a-8b07-8e58089c07cc tempest-VolumesSnapshotTestJSON-579482592 tempest-VolumesSnapshotTestJSON-579482592-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:07:19.441324 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-fb122c79-5f02-4b5a-8b07-8e58089c07cc tempest-VolumesSnapshotTestJSON-579482592 tempest-VolumesSnapshotTestJSON-579482592-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:07:19.441753 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-fb122c79-5f02-4b5a-8b07-8e58089c07cc tempest-VolumesSnapshotTestJSON-579482592 tempest-VolumesSnapshotTestJSON-579482592-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:07:19.574114 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-fb122c79-5f02-4b5a-8b07-8e58089c07cc tempest-VolumesSnapshotTestJSON-579482592 tempest-VolumesSnapshotTestJSON-579482592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9538a349ca91455f818e1b9d7758f400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a4d189a97b441ea2790d04daa79853', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 21:07:19.581626 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-fb122c79-5f02-4b5a-8b07-8e58089c07cc tempest-VolumesSnapshotTestJSON-579482592 tempest-VolumesSnapshotTestJSON-579482592-project] 10.222.0.20 "GET /compute/v2.1/servers/770a3b32-0743-4721-a8c8-61a4559ccbfa" status: 200 len: 1512 microversion: 2.1 time: 0.153643 Jul 05 21:07:19.582189 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 487/952] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 21:07:19 2022] GET /compute/v2.1/servers/770a3b32-0743-4721-a8c8-61a4559ccbfa => generated 1512 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 21:07:20.355858 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [req-e0e94f03-d3ea-40fe-9e72-2dc7781dbff4 req-5cf27138-a8da-47e8-a046-8fe4c75471ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "770a3b32-0743-4721-a8c8-61a4559ccbfa", "name": "network-vif-deleted", "tag": "3e4e3b56-35b6-4447-b6e2-14fa70ffa3c6"}]} {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 21:07:20.364830 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [req-e0e94f03-d3ea-40fe-9e72-2dc7781dbff4 req-5cf27138-a8da-47e8-a046-8fe4c75471ec service nova] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:07:20.365295 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [req-e0e94f03-d3ea-40fe-9e72-2dc7781dbff4 req-5cf27138-a8da-47e8-a046-8fe4c75471ec service nova] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:07:20.377194 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.compute.server_external_events [req-e0e94f03-d3ea-40fe-9e72-2dc7781dbff4 req-5cf27138-a8da-47e8-a046-8fe4c75471ec service nova] Creating event network-vif-deleted:3e4e3b56-35b6-4447-b6e2-14fa70ffa3c6 for instance 770a3b32-0743-4721-a8c8-61a4559ccbfa on hv-cinder-79760 Jul 05 21:07:20.382201 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [req-e0e94f03-d3ea-40fe-9e72-2dc7781dbff4 req-5cf27138-a8da-47e8-a046-8fe4c75471ec service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030256 Jul 05 21:07:20.383001 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 466/953] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 5 21:07:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 21:07:20.598367 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-570869dd-2145-4122-9a0b-d6b7e1180b5b tempest-VolumesSnapshotTestJSON-579482592 tempest-VolumesSnapshotTestJSON-579482592-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 21:07:20.598976 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-570869dd-2145-4122-9a0b-d6b7e1180b5b tempest-VolumesSnapshotTestJSON-579482592 tempest-VolumesSnapshotTestJSON-579482592-project] [instance: 770a3b32-0743-4721-a8c8-61a4559ccbfa] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 21:07:20.606276 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-570869dd-2145-4122-9a0b-d6b7e1180b5b tempest-VolumesSnapshotTestJSON-579482592 tempest-VolumesSnapshotTestJSON-579482592-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:07:20.606718 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-570869dd-2145-4122-9a0b-d6b7e1180b5b tempest-VolumesSnapshotTestJSON-579482592 tempest-VolumesSnapshotTestJSON-579482592-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:07:20.607468 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-570869dd-2145-4122-9a0b-d6b7e1180b5b tempest-VolumesSnapshotTestJSON-579482592 tempest-VolumesSnapshotTestJSON-579482592-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:07:20.607894 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-570869dd-2145-4122-9a0b-d6b7e1180b5b tempest-VolumesSnapshotTestJSON-579482592 tempest-VolumesSnapshotTestJSON-579482592-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:07:20.640995 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-570869dd-2145-4122-9a0b-d6b7e1180b5b tempest-VolumesSnapshotTestJSON-579482592 tempest-VolumesSnapshotTestJSON-579482592-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:07:20.641440 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-570869dd-2145-4122-9a0b-d6b7e1180b5b tempest-VolumesSnapshotTestJSON-579482592 tempest-VolumesSnapshotTestJSON-579482592-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:07:20.641879 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.objects.instance [None req-570869dd-2145-4122-9a0b-d6b7e1180b5b tempest-VolumesSnapshotTestJSON-579482592 tempest-VolumesSnapshotTestJSON-579482592-project] Lazy-loading 'fault' on Instance uuid 770a3b32-0743-4721-a8c8-61a4559ccbfa {{(pid=117628) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 05 21:07:20.683302 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-570869dd-2145-4122-9a0b-d6b7e1180b5b tempest-VolumesSnapshotTestJSON-579482592 tempest-VolumesSnapshotTestJSON-579482592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9538a349ca91455f818e1b9d7758f400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a4d189a97b441ea2790d04daa79853', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 21:07:20.690554 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-570869dd-2145-4122-9a0b-d6b7e1180b5b tempest-VolumesSnapshotTestJSON-579482592 tempest-VolumesSnapshotTestJSON-579482592-project] 10.222.0.20 "GET /compute/v2.1/servers/770a3b32-0743-4721-a8c8-61a4559ccbfa" status: 200 len: 1309 microversion: 2.1 time: 0.096084 Jul 05 21:07:20.691108 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 488/954] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 21:07:20 2022] GET /compute/v2.1/servers/770a3b32-0743-4721-a8c8-61a4559ccbfa => generated 1309 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 21:07:21.708464 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-36c4db9f-a939-49c1-96f5-d0f1f41888e2 tempest-VolumesSnapshotTestJSON-579482592 tempest-VolumesSnapshotTestJSON-579482592-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 21:07:21.709196 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-36c4db9f-a939-49c1-96f5-d0f1f41888e2 tempest-VolumesSnapshotTestJSON-579482592 tempest-VolumesSnapshotTestJSON-579482592-project] [instance: 770a3b32-0743-4721-a8c8-61a4559ccbfa] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 21:07:21.716006 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-36c4db9f-a939-49c1-96f5-d0f1f41888e2 tempest-VolumesSnapshotTestJSON-579482592 tempest-VolumesSnapshotTestJSON-579482592-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:07:21.716803 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-36c4db9f-a939-49c1-96f5-d0f1f41888e2 tempest-VolumesSnapshotTestJSON-579482592 tempest-VolumesSnapshotTestJSON-579482592-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:07:21.718122 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-36c4db9f-a939-49c1-96f5-d0f1f41888e2 tempest-VolumesSnapshotTestJSON-579482592 tempest-VolumesSnapshotTestJSON-579482592-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:07:21.718564 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-36c4db9f-a939-49c1-96f5-d0f1f41888e2 tempest-VolumesSnapshotTestJSON-579482592 tempest-VolumesSnapshotTestJSON-579482592-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:07:21.734571 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.wsgi [None req-36c4db9f-a939-49c1-96f5-d0f1f41888e2 tempest-VolumesSnapshotTestJSON-579482592 tempest-VolumesSnapshotTestJSON-579482592-project] HTTP exception thrown: Instance 770a3b32-0743-4721-a8c8-61a4559ccbfa could not be found. Jul 05 21:07:21.736215 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-36c4db9f-a939-49c1-96f5-d0f1f41888e2 tempest-VolumesSnapshotTestJSON-579482592 tempest-VolumesSnapshotTestJSON-579482592-project] Request method failure captured: Jul 05 21:07:21.736215 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: request: GET /compute/v2.1/servers/770a3b32-0743-4721-a8c8-61a4559ccbfa HTTP/1.1 Jul 05 21:07:21.736215 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: Accept: application/json Jul 05 21:07:21.736215 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: Accept-Encoding: identity Jul 05 21:07:21.736215 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: Connection: close Jul 05 21:07:21.736215 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: Content-Length: 0 Jul 05 21:07:21.736215 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: Content-Type: application/json Jul 05 21:07:21.736215 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: Host: 10.222.0.20 Jul 05 21:07:21.736215 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: Openstack-System-Scope: None Jul 05 21:07:21.736215 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: User-Agent: python-urllib3/1.26.9 Jul 05 21:07:21.736215 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Auth-Token: gAAAAABixKfWiRwBPqJAWUIX9YNwhH_7vW4EinaBDssYZMT8rGKRvjL-7KgsJp7cgm4QME5lKfEiFaCtduv1ReBVMYccCufo5XrSYAh4-fOEma9VrSmIX7b9EcY2kEKGndhvsQ8bA6OAbyPMUMW4i1YMIyiSite2xd-rqEqEc3U7fwfddhNiAFY Jul 05 21:07:21.736215 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Domain-Id: None Jul 05 21:07:21.736215 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Domain-Name: None Jul 05 21:07:21.736215 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Identity-Status: Confirmed Jul 05 21:07:21.736215 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Is-Admin-Project: True Jul 05 21:07:21.736215 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Project-Domain-Id: default Jul 05 21:07:21.736215 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Project-Domain-Name: Default Jul 05 21:07:21.736215 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Project-Id: c4a4d189a97b441ea2790d04daa79853 Jul 05 21:07:21.736215 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Project-Name: tempest-VolumesSnapshotTestJSON-579482592 Jul 05 21:07:21.736215 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Role: member,reader Jul 05 21:07:21.736215 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Roles: member,reader Jul 05 21:07:21.737970 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c4a4d189a97b441ea2790d04daa79853"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/c4a4d189a97b441ea2790d04daa79853"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_c4a4d189a97b441ea2790d04daa79853"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c4a4d189a97b441ea2790d04daa79853"}]}] Jul 05 21:07:21.737970 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Tenant: tempest-VolumesSnapshotTestJSON-579482592 Jul 05 21:07:21.737970 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Tenant-Id: c4a4d189a97b441ea2790d04daa79853 Jul 05 21:07:21.737970 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-579482592 Jul 05 21:07:21.737970 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-User: tempest-VolumesSnapshotTestJSON-579482592-project Jul 05 21:07:21.737970 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-User-Domain-Id: default Jul 05 21:07:21.737970 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-User-Domain-Name: Default Jul 05 21:07:21.737970 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-User-Id: 9538a349ca91455f818e1b9d7758f400 Jul 05 21:07:21.737970 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: X-User-Name: tempest-VolumesSnapshotTestJSON-579482592-project Jul 05 21:07:21.737970 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: method: > Jul 05 21:07:21.737970 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: exception: Instance 770a3b32-0743-4721-a8c8-61a4559ccbfa could not be found. Jul 05 21:07:21.737970 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: action_args: {'id': '770a3b32-0743-4721-a8c8-61a4559ccbfa'} Jul 05 21:07:21.739046 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 05 21:07:21.739046 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 21:07:21.739046 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 05 21:07:21.739046 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 05 21:07:21.739046 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 05 21:07:21.739046 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 05 21:07:21.739046 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 05 21:07:21.739046 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 05 21:07:21.739046 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 05 21:07:21.739046 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 05 21:07:21.739046 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 770a3b32-0743-4721-a8c8-61a4559ccbfa could not be found. Jul 05 21:07:21.739046 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi Jul 05 21:07:21.739046 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 21:07:21.739046 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi Jul 05 21:07:21.739046 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 21:07:21.739046 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 21:07:21.739046 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 21:07:21.739046 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 05 21:07:21.739046 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 05 21:07:21.739046 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 05 21:07:21.740699 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 05 21:07:21.740699 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 05 21:07:21.740699 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 05 21:07:21.740699 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 05 21:07:21.740699 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 05 21:07:21.740699 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 05 21:07:21.740699 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 05 21:07:21.740699 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 770a3b32-0743-4721-a8c8-61a4559ccbfa could not be found. Jul 05 21:07:21.740699 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi Jul 05 21:07:21.740699 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 21:07:21.740699 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi Jul 05 21:07:21.740699 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 21:07:21.740699 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 21:07:21.740699 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 21:07:21.740699 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 05 21:07:21.740699 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 05 21:07:21.740699 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 770a3b32-0743-4721-a8c8-61a4559ccbfa could not be found. Jul 05 21:07:21.740699 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: ERROR nova.api.openstack.wsgi Jul 05 21:07:21.742247 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-36c4db9f-a939-49c1-96f5-d0f1f41888e2 tempest-VolumesSnapshotTestJSON-579482592 tempest-VolumesSnapshotTestJSON-579482592-project] Returning 404 to user: Instance 770a3b32-0743-4721-a8c8-61a4559ccbfa could not be found. {{(pid=117627) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 05 21:07:21.742247 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-36c4db9f-a939-49c1-96f5-d0f1f41888e2 tempest-VolumesSnapshotTestJSON-579482592 tempest-VolumesSnapshotTestJSON-579482592-project] 10.222.0.20 "GET /compute/v2.1/servers/770a3b32-0743-4721-a8c8-61a4559ccbfa" status: 404 len: 111 microversion: 2.1 time: 0.033905 Jul 05 21:07:21.742247 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 467/955] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 21:07:21 2022] GET /compute/v2.1/servers/770a3b32-0743-4721-a8c8-61a4559ccbfa => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 05 21:07:29.529210 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-7dd771c9-4a17-47ad-b41a-ef493175d5aa tempest-VolumesSnapshotTestJSON-579482592 tempest-VolumesSnapshotTestJSON-579482592-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1328282219", "imageRef": "88e08f49-c01d-4849-a89f-b678588e56f4", "flavorRef": "452", "networks": [{"uuid": "fa935307-8051-40ce-884c-2ea255ade2b4"}]}} {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 21:07:29.580461 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.network.neutron [None req-7dd771c9-4a17-47ad-b41a-ef493175d5aa tempest-VolumesSnapshotTestJSON-579482592 tempest-VolumesSnapshotTestJSON-579482592-project] validate_networks() for [('fa935307-8051-40ce-884c-2ea255ade2b4', None, None, None, None, None)] {{(pid=117628) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 05 21:07:30.023708 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.virt.hardware [None req-7dd771c9-4a17-47ad-b41a-ef493175d5aa tempest-VolumesSnapshotTestJSON-579482592 tempest-VolumesSnapshotTestJSON-579482592-project] Flavor limits 0:0:0 {{(pid=117628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 05 21:07:30.024133 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.virt.hardware [None req-7dd771c9-4a17-47ad-b41a-ef493175d5aa tempest-VolumesSnapshotTestJSON-579482592 tempest-VolumesSnapshotTestJSON-579482592-project] Image limits 0:0:0 {{(pid=117628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 05 21:07:30.024711 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.virt.hardware [None req-7dd771c9-4a17-47ad-b41a-ef493175d5aa tempest-VolumesSnapshotTestJSON-579482592 tempest-VolumesSnapshotTestJSON-579482592-project] Flavor pref 0:0:0 {{(pid=117628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 05 21:07:30.024711 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.virt.hardware [None req-7dd771c9-4a17-47ad-b41a-ef493175d5aa tempest-VolumesSnapshotTestJSON-579482592 tempest-VolumesSnapshotTestJSON-579482592-project] Image pref 0:0:0 {{(pid=117628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 05 21:07:30.025534 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.virt.hardware [None req-7dd771c9-4a17-47ad-b41a-ef493175d5aa tempest-VolumesSnapshotTestJSON-579482592 tempest-VolumesSnapshotTestJSON-579482592-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 05 21:07:30.037572 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-7dd771c9-4a17-47ad-b41a-ef493175d5aa tempest-VolumesSnapshotTestJSON-579482592 tempest-VolumesSnapshotTestJSON-579482592-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:07:30.038128 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-7dd771c9-4a17-47ad-b41a-ef493175d5aa tempest-VolumesSnapshotTestJSON-579482592 tempest-VolumesSnapshotTestJSON-579482592-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:07:30.038950 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-7dd771c9-4a17-47ad-b41a-ef493175d5aa tempest-VolumesSnapshotTestJSON-579482592 tempest-VolumesSnapshotTestJSON-579482592-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:07:30.039368 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-7dd771c9-4a17-47ad-b41a-ef493175d5aa tempest-VolumesSnapshotTestJSON-579482592 tempest-VolumesSnapshotTestJSON-579482592-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:07:30.058626 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.quota [None req-7dd771c9-4a17-47ad-b41a-ef493175d5aa tempest-VolumesSnapshotTestJSON-579482592 tempest-VolumesSnapshotTestJSON-579482592-project] Getting quotas for project c4a4d189a97b441ea2790d04daa79853. Resources: {'cores', 'ram', 'instances'} {{(pid=117628) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 05 21:07:30.062646 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.quota [None req-7dd771c9-4a17-47ad-b41a-ef493175d5aa tempest-VolumesSnapshotTestJSON-579482592 tempest-VolumesSnapshotTestJSON-579482592-project] Getting quotas for user 9538a349ca91455f818e1b9d7758f400 and project c4a4d189a97b441ea2790d04daa79853. Resources: {'cores', 'ram', 'instances'} {{(pid=117628) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 05 21:07:30.074162 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-7dd771c9-4a17-47ad-b41a-ef493175d5aa tempest-VolumesSnapshotTestJSON-579482592 tempest-VolumesSnapshotTestJSON-579482592-project] Going to run 1 instances... {{(pid=117628) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 05 21:07:30.076388 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-7dd771c9-4a17-47ad-b41a-ef493175d5aa tempest-VolumesSnapshotTestJSON-579482592 tempest-VolumesSnapshotTestJSON-579482592-project] [instance: e9c39bcf-1003-4e31-8974-024540459277] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='88e08f49-c01d-4849-a89f-b678588e56f4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117628) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 05 21:07:30.124777 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-7dd771c9-4a17-47ad-b41a-ef493175d5aa tempest-VolumesSnapshotTestJSON-579482592 tempest-VolumesSnapshotTestJSON-579482592-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.599882 Jul 05 21:07:30.125459 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 489/956] 10.222.0.20 () {60 vars in 1146 bytes} [Tue Jul 5 21:07:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 601 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 05 21:07:30.138163 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-6c851b8c-981f-4fcf-a8eb-2032c6a75fe8 tempest-VolumesSnapshotTestJSON-579482592 tempest-VolumesSnapshotTestJSON-579482592-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 21:07:30.138775 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-6c851b8c-981f-4fcf-a8eb-2032c6a75fe8 tempest-VolumesSnapshotTestJSON-579482592 tempest-VolumesSnapshotTestJSON-579482592-project] [instance: e9c39bcf-1003-4e31-8974-024540459277] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 21:07:30.194855 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-6c851b8c-981f-4fcf-a8eb-2032c6a75fe8 tempest-VolumesSnapshotTestJSON-579482592 tempest-VolumesSnapshotTestJSON-579482592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9538a349ca91455f818e1b9d7758f400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a4d189a97b441ea2790d04daa79853', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 21:07:30.203485 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-6c851b8c-981f-4fcf-a8eb-2032c6a75fe8 tempest-VolumesSnapshotTestJSON-579482592 tempest-VolumesSnapshotTestJSON-579482592-project] 10.222.0.20 "GET /compute/v2.1/servers/e9c39bcf-1003-4e31-8974-024540459277" status: 200 len: 1219 microversion: 2.1 time: 0.069669 Jul 05 21:07:30.203957 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 468/957] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 21:07:30 2022] GET /compute/v2.1/servers/e9c39bcf-1003-4e31-8974-024540459277 => generated 1219 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 21:07:31.221756 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-d58563e8-6da8-4b0f-88d0-f9c6e832546b tempest-VolumesSnapshotTestJSON-579482592 tempest-VolumesSnapshotTestJSON-579482592-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 21:07:31.222613 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-d58563e8-6da8-4b0f-88d0-f9c6e832546b tempest-VolumesSnapshotTestJSON-579482592 tempest-VolumesSnapshotTestJSON-579482592-project] [instance: e9c39bcf-1003-4e31-8974-024540459277] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 21:07:31.230086 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-d58563e8-6da8-4b0f-88d0-f9c6e832546b tempest-VolumesSnapshotTestJSON-579482592 tempest-VolumesSnapshotTestJSON-579482592-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:07:31.230669 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-d58563e8-6da8-4b0f-88d0-f9c6e832546b tempest-VolumesSnapshotTestJSON-579482592 tempest-VolumesSnapshotTestJSON-579482592-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:07:31.231601 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-d58563e8-6da8-4b0f-88d0-f9c6e832546b tempest-VolumesSnapshotTestJSON-579482592 tempest-VolumesSnapshotTestJSON-579482592-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:07:31.232312 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-d58563e8-6da8-4b0f-88d0-f9c6e832546b tempest-VolumesSnapshotTestJSON-579482592 tempest-VolumesSnapshotTestJSON-579482592-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:07:31.323890 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-d58563e8-6da8-4b0f-88d0-f9c6e832546b tempest-VolumesSnapshotTestJSON-579482592 tempest-VolumesSnapshotTestJSON-579482592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9538a349ca91455f818e1b9d7758f400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a4d189a97b441ea2790d04daa79853', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 21:07:31.331271 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-d58563e8-6da8-4b0f-88d0-f9c6e832546b tempest-VolumesSnapshotTestJSON-579482592 tempest-VolumesSnapshotTestJSON-579482592-project] 10.222.0.20 "GET /compute/v2.1/servers/e9c39bcf-1003-4e31-8974-024540459277" status: 200 len: 1277 microversion: 2.1 time: 0.114994 Jul 05 21:07:31.331835 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 490/958] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 21:07:31 2022] GET /compute/v2.1/servers/e9c39bcf-1003-4e31-8974-024540459277 => generated 1277 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 21:07:32.349745 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-70939a5a-f56d-4b47-99f1-3087d75f702f tempest-VolumesSnapshotTestJSON-579482592 tempest-VolumesSnapshotTestJSON-579482592-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 21:07:32.350354 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-70939a5a-f56d-4b47-99f1-3087d75f702f tempest-VolumesSnapshotTestJSON-579482592 tempest-VolumesSnapshotTestJSON-579482592-project] [instance: e9c39bcf-1003-4e31-8974-024540459277] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 21:07:32.352725 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG dbcounter [-] [117627] Writing DB stats nova_cell1:SELECT=19,nova_cell1:INSERT=1 {{(pid=117627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:07:32.360414 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-70939a5a-f56d-4b47-99f1-3087d75f702f tempest-VolumesSnapshotTestJSON-579482592 tempest-VolumesSnapshotTestJSON-579482592-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:07:32.360955 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-70939a5a-f56d-4b47-99f1-3087d75f702f tempest-VolumesSnapshotTestJSON-579482592 tempest-VolumesSnapshotTestJSON-579482592-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:07:32.361811 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-70939a5a-f56d-4b47-99f1-3087d75f702f tempest-VolumesSnapshotTestJSON-579482592 tempest-VolumesSnapshotTestJSON-579482592-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:07:32.362244 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-70939a5a-f56d-4b47-99f1-3087d75f702f tempest-VolumesSnapshotTestJSON-579482592 tempest-VolumesSnapshotTestJSON-579482592-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:07:32.485675 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [req-6a675d44-6f95-4a46-abd2-4cb02798abbe req-9bb85b67-855c-4b81-9f96-8f5a0934ca39 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e9c39bcf-1003-4e31-8974-024540459277", "tag": "afd3830b-3253-4ce8-b5de-88eab125141e"}]} {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 21:07:32.496788 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [req-6a675d44-6f95-4a46-abd2-4cb02798abbe req-9bb85b67-855c-4b81-9f96-8f5a0934ca39 service nova] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:07:32.497439 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [req-6a675d44-6f95-4a46-abd2-4cb02798abbe req-9bb85b67-855c-4b81-9f96-8f5a0934ca39 service nova] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:07:32.508653 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.compute.server_external_events [req-6a675d44-6f95-4a46-abd2-4cb02798abbe req-9bb85b67-855c-4b81-9f96-8f5a0934ca39 service nova] Creating event network-changed:afd3830b-3253-4ce8-b5de-88eab125141e for instance e9c39bcf-1003-4e31-8974-024540459277 on hv-cinder-79760 Jul 05 21:07:32.514758 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [req-6a675d44-6f95-4a46-abd2-4cb02798abbe req-9bb85b67-855c-4b81-9f96-8f5a0934ca39 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033399 Jul 05 21:07:32.515450 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 491/959] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 5 21:07:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 05 21:07:32.593732 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-70939a5a-f56d-4b47-99f1-3087d75f702f tempest-VolumesSnapshotTestJSON-579482592 tempest-VolumesSnapshotTestJSON-579482592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9538a349ca91455f818e1b9d7758f400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a4d189a97b441ea2790d04daa79853', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 21:07:32.601159 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-70939a5a-f56d-4b47-99f1-3087d75f702f tempest-VolumesSnapshotTestJSON-579482592 tempest-VolumesSnapshotTestJSON-579482592-project] 10.222.0.20 "GET /compute/v2.1/servers/e9c39bcf-1003-4e31-8974-024540459277" status: 200 len: 1319 microversion: 2.1 time: 0.255216 Jul 05 21:07:32.601744 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 469/960] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 21:07:32 2022] GET /compute/v2.1/servers/e9c39bcf-1003-4e31-8974-024540459277 => generated 1319 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 21:07:33.620196 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-e4a67c48-4958-40c7-8248-498fe5e8d6b3 tempest-VolumesSnapshotTestJSON-579482592 tempest-VolumesSnapshotTestJSON-579482592-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 21:07:33.620902 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-e4a67c48-4958-40c7-8248-498fe5e8d6b3 tempest-VolumesSnapshotTestJSON-579482592 tempest-VolumesSnapshotTestJSON-579482592-project] [instance: e9c39bcf-1003-4e31-8974-024540459277] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 21:07:33.627160 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-e4a67c48-4958-40c7-8248-498fe5e8d6b3 tempest-VolumesSnapshotTestJSON-579482592 tempest-VolumesSnapshotTestJSON-579482592-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:07:33.627600 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-e4a67c48-4958-40c7-8248-498fe5e8d6b3 tempest-VolumesSnapshotTestJSON-579482592 tempest-VolumesSnapshotTestJSON-579482592-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:07:33.628347 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-e4a67c48-4958-40c7-8248-498fe5e8d6b3 tempest-VolumesSnapshotTestJSON-579482592 tempest-VolumesSnapshotTestJSON-579482592-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:07:33.628775 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-e4a67c48-4958-40c7-8248-498fe5e8d6b3 tempest-VolumesSnapshotTestJSON-579482592 tempest-VolumesSnapshotTestJSON-579482592-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:07:33.850498 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-e4a67c48-4958-40c7-8248-498fe5e8d6b3 tempest-VolumesSnapshotTestJSON-579482592 tempest-VolumesSnapshotTestJSON-579482592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9538a349ca91455f818e1b9d7758f400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a4d189a97b441ea2790d04daa79853', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 21:07:33.858590 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-e4a67c48-4958-40c7-8248-498fe5e8d6b3 tempest-VolumesSnapshotTestJSON-579482592 tempest-VolumesSnapshotTestJSON-579482592-project] 10.222.0.20 "GET /compute/v2.1/servers/e9c39bcf-1003-4e31-8974-024540459277" status: 200 len: 1319 microversion: 2.1 time: 0.243793 Jul 05 21:07:33.859158 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 492/961] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 21:07:33 2022] GET /compute/v2.1/servers/e9c39bcf-1003-4e31-8974-024540459277 => generated 1319 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 21:07:34.875642 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-02ce2ca6-0ac4-408a-ba0b-2d504a236c23 tempest-VolumesSnapshotTestJSON-579482592 tempest-VolumesSnapshotTestJSON-579482592-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 21:07:34.876246 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-02ce2ca6-0ac4-408a-ba0b-2d504a236c23 tempest-VolumesSnapshotTestJSON-579482592 tempest-VolumesSnapshotTestJSON-579482592-project] [instance: e9c39bcf-1003-4e31-8974-024540459277] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 21:07:34.882242 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-02ce2ca6-0ac4-408a-ba0b-2d504a236c23 tempest-VolumesSnapshotTestJSON-579482592 tempest-VolumesSnapshotTestJSON-579482592-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:07:34.882681 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-02ce2ca6-0ac4-408a-ba0b-2d504a236c23 tempest-VolumesSnapshotTestJSON-579482592 tempest-VolumesSnapshotTestJSON-579482592-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:07:34.883714 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-02ce2ca6-0ac4-408a-ba0b-2d504a236c23 tempest-VolumesSnapshotTestJSON-579482592 tempest-VolumesSnapshotTestJSON-579482592-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:07:34.884334 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-02ce2ca6-0ac4-408a-ba0b-2d504a236c23 tempest-VolumesSnapshotTestJSON-579482592 tempest-VolumesSnapshotTestJSON-579482592-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:07:35.015214 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-02ce2ca6-0ac4-408a-ba0b-2d504a236c23 tempest-VolumesSnapshotTestJSON-579482592 tempest-VolumesSnapshotTestJSON-579482592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9538a349ca91455f818e1b9d7758f400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a4d189a97b441ea2790d04daa79853', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 21:07:35.022695 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-02ce2ca6-0ac4-408a-ba0b-2d504a236c23 tempest-VolumesSnapshotTestJSON-579482592 tempest-VolumesSnapshotTestJSON-579482592-project] 10.222.0.20 "GET /compute/v2.1/servers/e9c39bcf-1003-4e31-8974-024540459277" status: 200 len: 1319 microversion: 2.1 time: 0.150964 Jul 05 21:07:35.023192 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 470/962] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 21:07:34 2022] GET /compute/v2.1/servers/e9c39bcf-1003-4e31-8974-024540459277 => generated 1319 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 21:07:36.039556 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-67cf7440-bc5a-4f09-9de1-f05ae2d5beb0 tempest-VolumesSnapshotTestJSON-579482592 tempest-VolumesSnapshotTestJSON-579482592-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 21:07:36.040983 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-67cf7440-bc5a-4f09-9de1-f05ae2d5beb0 tempest-VolumesSnapshotTestJSON-579482592 tempest-VolumesSnapshotTestJSON-579482592-project] [instance: e9c39bcf-1003-4e31-8974-024540459277] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 21:07:36.047341 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-67cf7440-bc5a-4f09-9de1-f05ae2d5beb0 tempest-VolumesSnapshotTestJSON-579482592 tempest-VolumesSnapshotTestJSON-579482592-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:07:36.047785 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-67cf7440-bc5a-4f09-9de1-f05ae2d5beb0 tempest-VolumesSnapshotTestJSON-579482592 tempest-VolumesSnapshotTestJSON-579482592-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:07:36.048547 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-67cf7440-bc5a-4f09-9de1-f05ae2d5beb0 tempest-VolumesSnapshotTestJSON-579482592 tempest-VolumesSnapshotTestJSON-579482592-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:07:36.049001 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-67cf7440-bc5a-4f09-9de1-f05ae2d5beb0 tempest-VolumesSnapshotTestJSON-579482592 tempest-VolumesSnapshotTestJSON-579482592-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:07:36.178991 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-67cf7440-bc5a-4f09-9de1-f05ae2d5beb0 tempest-VolumesSnapshotTestJSON-579482592 tempest-VolumesSnapshotTestJSON-579482592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9538a349ca91455f818e1b9d7758f400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a4d189a97b441ea2790d04daa79853', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 21:07:36.186414 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-67cf7440-bc5a-4f09-9de1-f05ae2d5beb0 tempest-VolumesSnapshotTestJSON-579482592 tempest-VolumesSnapshotTestJSON-579482592-project] 10.222.0.20 "GET /compute/v2.1/servers/e9c39bcf-1003-4e31-8974-024540459277" status: 200 len: 1319 microversion: 2.1 time: 0.150724 Jul 05 21:07:36.186976 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 493/963] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 21:07:36 2022] GET /compute/v2.1/servers/e9c39bcf-1003-4e31-8974-024540459277 => generated 1319 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 21:07:37.203548 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-7ab4dfcf-6d75-407f-9f25-122336e65c2c tempest-VolumesSnapshotTestJSON-579482592 tempest-VolumesSnapshotTestJSON-579482592-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 21:07:37.204176 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-7ab4dfcf-6d75-407f-9f25-122336e65c2c tempest-VolumesSnapshotTestJSON-579482592 tempest-VolumesSnapshotTestJSON-579482592-project] [instance: e9c39bcf-1003-4e31-8974-024540459277] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 21:07:37.210714 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-7ab4dfcf-6d75-407f-9f25-122336e65c2c tempest-VolumesSnapshotTestJSON-579482592 tempest-VolumesSnapshotTestJSON-579482592-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:07:37.211159 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-7ab4dfcf-6d75-407f-9f25-122336e65c2c tempest-VolumesSnapshotTestJSON-579482592 tempest-VolumesSnapshotTestJSON-579482592-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:07:37.211915 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-7ab4dfcf-6d75-407f-9f25-122336e65c2c tempest-VolumesSnapshotTestJSON-579482592 tempest-VolumesSnapshotTestJSON-579482592-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:07:37.212992 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-7ab4dfcf-6d75-407f-9f25-122336e65c2c tempest-VolumesSnapshotTestJSON-579482592 tempest-VolumesSnapshotTestJSON-579482592-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:07:37.343312 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-7ab4dfcf-6d75-407f-9f25-122336e65c2c tempest-VolumesSnapshotTestJSON-579482592 tempest-VolumesSnapshotTestJSON-579482592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9538a349ca91455f818e1b9d7758f400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a4d189a97b441ea2790d04daa79853', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 21:07:37.350727 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-7ab4dfcf-6d75-407f-9f25-122336e65c2c tempest-VolumesSnapshotTestJSON-579482592 tempest-VolumesSnapshotTestJSON-579482592-project] 10.222.0.20 "GET /compute/v2.1/servers/e9c39bcf-1003-4e31-8974-024540459277" status: 200 len: 1319 microversion: 2.1 time: 0.151039 Jul 05 21:07:37.351290 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 471/964] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 21:07:37 2022] GET /compute/v2.1/servers/e9c39bcf-1003-4e31-8974-024540459277 => generated 1319 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 21:07:38.004699 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [req-5358d426-b60a-4a37-8f74-f2619b6fea26 req-ba23e7b0-6f08-4e53-b94e-5f93c2e41132 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9c39bcf-1003-4e31-8974-024540459277", "name": "network-vif-plugged", "status": "completed", "tag": "afd3830b-3253-4ce8-b5de-88eab125141e"}]} {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 21:07:38.014042 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [req-5358d426-b60a-4a37-8f74-f2619b6fea26 req-ba23e7b0-6f08-4e53-b94e-5f93c2e41132 service nova] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:07:38.014487 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [req-5358d426-b60a-4a37-8f74-f2619b6fea26 req-ba23e7b0-6f08-4e53-b94e-5f93c2e41132 service nova] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:07:38.025785 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.compute.server_external_events [req-5358d426-b60a-4a37-8f74-f2619b6fea26 req-ba23e7b0-6f08-4e53-b94e-5f93c2e41132 service nova] Creating event network-vif-plugged:afd3830b-3253-4ce8-b5de-88eab125141e for instance e9c39bcf-1003-4e31-8974-024540459277 on hv-cinder-79760 Jul 05 21:07:38.030491 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [req-5358d426-b60a-4a37-8f74-f2619b6fea26 req-ba23e7b0-6f08-4e53-b94e-5f93c2e41132 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029561 Jul 05 21:07:38.031071 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 494/965] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 5 21:07:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 21:07:38.367265 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-ac21f1c6-e3b0-4893-8d39-316504c2fc14 tempest-VolumesSnapshotTestJSON-579482592 tempest-VolumesSnapshotTestJSON-579482592-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 21:07:38.367874 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-ac21f1c6-e3b0-4893-8d39-316504c2fc14 tempest-VolumesSnapshotTestJSON-579482592 tempest-VolumesSnapshotTestJSON-579482592-project] [instance: e9c39bcf-1003-4e31-8974-024540459277] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 21:07:38.375554 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-ac21f1c6-e3b0-4893-8d39-316504c2fc14 tempest-VolumesSnapshotTestJSON-579482592 tempest-VolumesSnapshotTestJSON-579482592-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:07:38.375997 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-ac21f1c6-e3b0-4893-8d39-316504c2fc14 tempest-VolumesSnapshotTestJSON-579482592 tempest-VolumesSnapshotTestJSON-579482592-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:07:38.376750 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-ac21f1c6-e3b0-4893-8d39-316504c2fc14 tempest-VolumesSnapshotTestJSON-579482592 tempest-VolumesSnapshotTestJSON-579482592-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:07:38.377215 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-ac21f1c6-e3b0-4893-8d39-316504c2fc14 tempest-VolumesSnapshotTestJSON-579482592 tempest-VolumesSnapshotTestJSON-579482592-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:07:38.512505 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-ac21f1c6-e3b0-4893-8d39-316504c2fc14 tempest-VolumesSnapshotTestJSON-579482592 tempest-VolumesSnapshotTestJSON-579482592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9538a349ca91455f818e1b9d7758f400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a4d189a97b441ea2790d04daa79853', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 21:07:38.520069 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-ac21f1c6-e3b0-4893-8d39-316504c2fc14 tempest-VolumesSnapshotTestJSON-579482592 tempest-VolumesSnapshotTestJSON-579482592-project] 10.222.0.20 "GET /compute/v2.1/servers/e9c39bcf-1003-4e31-8974-024540459277" status: 200 len: 1319 microversion: 2.1 time: 0.156695 Jul 05 21:07:38.520619 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 472/966] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 21:07:38 2022] GET /compute/v2.1/servers/e9c39bcf-1003-4e31-8974-024540459277 => generated 1319 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 21:07:39.537348 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-6c882fbd-c527-458b-9731-f03719032ede tempest-VolumesSnapshotTestJSON-579482592 tempest-VolumesSnapshotTestJSON-579482592-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 21:07:39.538041 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-6c882fbd-c527-458b-9731-f03719032ede tempest-VolumesSnapshotTestJSON-579482592 tempest-VolumesSnapshotTestJSON-579482592-project] [instance: e9c39bcf-1003-4e31-8974-024540459277] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 21:07:39.544528 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-6c882fbd-c527-458b-9731-f03719032ede tempest-VolumesSnapshotTestJSON-579482592 tempest-VolumesSnapshotTestJSON-579482592-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:07:39.545005 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-6c882fbd-c527-458b-9731-f03719032ede tempest-VolumesSnapshotTestJSON-579482592 tempest-VolumesSnapshotTestJSON-579482592-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:07:39.545789 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-6c882fbd-c527-458b-9731-f03719032ede tempest-VolumesSnapshotTestJSON-579482592 tempest-VolumesSnapshotTestJSON-579482592-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:07:39.546222 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-6c882fbd-c527-458b-9731-f03719032ede tempest-VolumesSnapshotTestJSON-579482592 tempest-VolumesSnapshotTestJSON-579482592-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:07:39.679721 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-6c882fbd-c527-458b-9731-f03719032ede tempest-VolumesSnapshotTestJSON-579482592 tempest-VolumesSnapshotTestJSON-579482592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9538a349ca91455f818e1b9d7758f400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a4d189a97b441ea2790d04daa79853', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 21:07:39.687878 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-6c882fbd-c527-458b-9731-f03719032ede tempest-VolumesSnapshotTestJSON-579482592 tempest-VolumesSnapshotTestJSON-579482592-project] 10.222.0.20 "GET /compute/v2.1/servers/e9c39bcf-1003-4e31-8974-024540459277" status: 200 len: 1507 microversion: 2.1 time: 0.155132 Jul 05 21:07:39.688436 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 495/967] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 21:07:39 2022] GET /compute/v2.1/servers/e9c39bcf-1003-4e31-8974-024540459277 => generated 1507 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 21:07:39.704712 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-165192c5-b062-4e58-9f1d-0ca4935783af tempest-VolumesSnapshotTestJSON-579482592 tempest-VolumesSnapshotTestJSON-579482592-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0f00b712-1378-4c65-b6ef-006bd713c754", "device": "/dev/sdb"}} {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 21:07:39.706368 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-165192c5-b062-4e58-9f1d-0ca4935783af tempest-VolumesSnapshotTestJSON-579482592 tempest-VolumesSnapshotTestJSON-579482592-project] [instance: e9c39bcf-1003-4e31-8974-024540459277] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 21:07:39.713339 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-165192c5-b062-4e58-9f1d-0ca4935783af tempest-VolumesSnapshotTestJSON-579482592 tempest-VolumesSnapshotTestJSON-579482592-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:07:39.713792 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-165192c5-b062-4e58-9f1d-0ca4935783af tempest-VolumesSnapshotTestJSON-579482592 tempest-VolumesSnapshotTestJSON-579482592-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:07:39.714554 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-165192c5-b062-4e58-9f1d-0ca4935783af tempest-VolumesSnapshotTestJSON-579482592 tempest-VolumesSnapshotTestJSON-579482592-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:07:39.715024 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-165192c5-b062-4e58-9f1d-0ca4935783af tempest-VolumesSnapshotTestJSON-579482592 tempest-VolumesSnapshotTestJSON-579482592-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:07:39.956774 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-165192c5-b062-4e58-9f1d-0ca4935783af tempest-VolumesSnapshotTestJSON-579482592 tempest-VolumesSnapshotTestJSON-579482592-project] 10.222.0.20 "POST /compute/v2.1/servers/e9c39bcf-1003-4e31-8974-024540459277/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.255806 Jul 05 21:07:39.957400 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 473/968] 10.222.0.20 () {60 vars in 1322 bytes} [Tue Jul 5 21:07:39 2022] POST /compute/v2.1/servers/e9c39bcf-1003-4e31-8974-024540459277/os-volume_attachments => generated 194 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 21:07:56.143044 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-9b1de578-03b8-4085-b1eb-04c497137343 tempest-VolumesSnapshotTestJSON-579482592 tempest-VolumesSnapshotTestJSON-579482592-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 21:07:56.143806 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-9b1de578-03b8-4085-b1eb-04c497137343 tempest-VolumesSnapshotTestJSON-579482592 tempest-VolumesSnapshotTestJSON-579482592-project] [instance: e9c39bcf-1003-4e31-8974-024540459277] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 21:07:56.145783 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG dbcounter [-] [117628] Writing DB stats nova_cell0:SELECT=2 {{(pid=117628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:07:56.146564 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG dbcounter [-] [117628] Writing DB stats nova_cell0:SELECT=6 {{(pid=117628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:07:56.147108 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG dbcounter [-] [117628] Writing DB stats nova_api:SELECT=38,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=117628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:07:56.147722 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG dbcounter [-] [117628] Writing DB stats nova_cell1:SELECT=58,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:07:56.154496 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-9b1de578-03b8-4085-b1eb-04c497137343 tempest-VolumesSnapshotTestJSON-579482592 tempest-VolumesSnapshotTestJSON-579482592-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:07:56.154935 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-9b1de578-03b8-4085-b1eb-04c497137343 tempest-VolumesSnapshotTestJSON-579482592 tempest-VolumesSnapshotTestJSON-579482592-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:07:56.155689 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-9b1de578-03b8-4085-b1eb-04c497137343 tempest-VolumesSnapshotTestJSON-579482592 tempest-VolumesSnapshotTestJSON-579482592-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:07:56.156119 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-9b1de578-03b8-4085-b1eb-04c497137343 tempest-VolumesSnapshotTestJSON-579482592 tempest-VolumesSnapshotTestJSON-579482592-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:07:56.239027 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.objects.instance [None req-9b1de578-03b8-4085-b1eb-04c497137343 tempest-VolumesSnapshotTestJSON-579482592 tempest-VolumesSnapshotTestJSON-579482592-project] Lazy-loading 'services' on Instance uuid e9c39bcf-1003-4e31-8974-024540459277 {{(pid=117628) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 05 21:07:56.310535 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-9b1de578-03b8-4085-b1eb-04c497137343 tempest-VolumesSnapshotTestJSON-579482592 tempest-VolumesSnapshotTestJSON-579482592-project] 10.222.0.20 "DELETE /compute/v2.1/servers/e9c39bcf-1003-4e31-8974-024540459277/os-volume_attachments/0f00b712-1378-4c65-b6ef-006bd713c754" status: 202 len: 0 microversion: 2.1 time: 0.171393 Jul 05 21:07:56.311259 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 496/969] 10.222.0.20 () {58 vars in 1415 bytes} [Tue Jul 5 21:07:56 2022] DELETE /compute/v2.1/servers/e9c39bcf-1003-4e31-8974-024540459277/os-volume_attachments/0f00b712-1378-4c65-b6ef-006bd713c754 => generated 0 bytes in 173 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 05 21:07:57.419686 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG dbcounter [-] [117627] Writing DB stats nova_cell0:SELECT=2 {{(pid=117627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:07:57.420515 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG dbcounter [-] [117627] Writing DB stats nova_api:SELECT=22 {{(pid=117627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:07:57.421190 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG dbcounter [-] [117627] Writing DB stats nova_cell1:SELECT=35,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:07:57.425409 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-dbeb8324-699f-4b8e-8fb3-23698be8fe0d tempest-VolumesSnapshotTestJSON-579482592 tempest-VolumesSnapshotTestJSON-579482592-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 21:07:57.426022 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-dbeb8324-699f-4b8e-8fb3-23698be8fe0d tempest-VolumesSnapshotTestJSON-579482592 tempest-VolumesSnapshotTestJSON-579482592-project] [instance: e9c39bcf-1003-4e31-8974-024540459277] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 21:07:57.435029 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-dbeb8324-699f-4b8e-8fb3-23698be8fe0d tempest-VolumesSnapshotTestJSON-579482592 tempest-VolumesSnapshotTestJSON-579482592-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:07:57.435473 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-dbeb8324-699f-4b8e-8fb3-23698be8fe0d tempest-VolumesSnapshotTestJSON-579482592 tempest-VolumesSnapshotTestJSON-579482592-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:07:57.436238 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-dbeb8324-699f-4b8e-8fb3-23698be8fe0d tempest-VolumesSnapshotTestJSON-579482592 tempest-VolumesSnapshotTestJSON-579482592-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:07:57.436670 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-dbeb8324-699f-4b8e-8fb3-23698be8fe0d tempest-VolumesSnapshotTestJSON-579482592 tempest-VolumesSnapshotTestJSON-579482592-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:07:57.464452 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-dbeb8324-699f-4b8e-8fb3-23698be8fe0d tempest-VolumesSnapshotTestJSON-579482592 tempest-VolumesSnapshotTestJSON-579482592-project] [instance: e9c39bcf-1003-4e31-8974-024540459277] Going to try to terminate instance {{(pid=117627) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 05 21:07:57.540591 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-dbeb8324-699f-4b8e-8fb3-23698be8fe0d tempest-VolumesSnapshotTestJSON-579482592 tempest-VolumesSnapshotTestJSON-579482592-project] 10.222.0.20 "DELETE /compute/v2.1/servers/e9c39bcf-1003-4e31-8974-024540459277" status: 204 len: 0 microversion: 2.1 time: 0.121504 Jul 05 21:07:57.541731 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 474/970] 10.222.0.20 () {58 vars in 1238 bytes} [Tue Jul 5 21:07:57 2022] DELETE /compute/v2.1/servers/e9c39bcf-1003-4e31-8974-024540459277 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 05 21:07:57.551547 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-cefb4273-7b03-49bd-9689-1004e9599de8 tempest-VolumesSnapshotTestJSON-579482592 tempest-VolumesSnapshotTestJSON-579482592-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 21:07:57.552737 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-cefb4273-7b03-49bd-9689-1004e9599de8 tempest-VolumesSnapshotTestJSON-579482592 tempest-VolumesSnapshotTestJSON-579482592-project] [instance: e9c39bcf-1003-4e31-8974-024540459277] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 21:07:57.560369 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-cefb4273-7b03-49bd-9689-1004e9599de8 tempest-VolumesSnapshotTestJSON-579482592 tempest-VolumesSnapshotTestJSON-579482592-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:07:57.560813 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-cefb4273-7b03-49bd-9689-1004e9599de8 tempest-VolumesSnapshotTestJSON-579482592 tempest-VolumesSnapshotTestJSON-579482592-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:07:57.561608 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-cefb4273-7b03-49bd-9689-1004e9599de8 tempest-VolumesSnapshotTestJSON-579482592 tempest-VolumesSnapshotTestJSON-579482592-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:07:57.562043 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-cefb4273-7b03-49bd-9689-1004e9599de8 tempest-VolumesSnapshotTestJSON-579482592 tempest-VolumesSnapshotTestJSON-579482592-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:07:57.699158 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-cefb4273-7b03-49bd-9689-1004e9599de8 tempest-VolumesSnapshotTestJSON-579482592 tempest-VolumesSnapshotTestJSON-579482592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9538a349ca91455f818e1b9d7758f400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a4d189a97b441ea2790d04daa79853', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 21:07:57.706643 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-cefb4273-7b03-49bd-9689-1004e9599de8 tempest-VolumesSnapshotTestJSON-579482592 tempest-VolumesSnapshotTestJSON-579482592-project] 10.222.0.20 "GET /compute/v2.1/servers/e9c39bcf-1003-4e31-8974-024540459277" status: 200 len: 1513 microversion: 2.1 time: 0.160368 Jul 05 21:07:57.707199 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 497/971] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 21:07:57 2022] GET /compute/v2.1/servers/e9c39bcf-1003-4e31-8974-024540459277 => generated 1513 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 21:07:58.724538 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-55ae0763-46ce-4aa8-9a19-1ab137cde578 tempest-VolumesSnapshotTestJSON-579482592 tempest-VolumesSnapshotTestJSON-579482592-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 21:07:58.725256 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-55ae0763-46ce-4aa8-9a19-1ab137cde578 tempest-VolumesSnapshotTestJSON-579482592 tempest-VolumesSnapshotTestJSON-579482592-project] [instance: e9c39bcf-1003-4e31-8974-024540459277] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 21:07:58.731692 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-55ae0763-46ce-4aa8-9a19-1ab137cde578 tempest-VolumesSnapshotTestJSON-579482592 tempest-VolumesSnapshotTestJSON-579482592-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:07:58.732131 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-55ae0763-46ce-4aa8-9a19-1ab137cde578 tempest-VolumesSnapshotTestJSON-579482592 tempest-VolumesSnapshotTestJSON-579482592-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:07:58.732877 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-55ae0763-46ce-4aa8-9a19-1ab137cde578 tempest-VolumesSnapshotTestJSON-579482592 tempest-VolumesSnapshotTestJSON-579482592-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:07:58.733331 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-55ae0763-46ce-4aa8-9a19-1ab137cde578 tempest-VolumesSnapshotTestJSON-579482592 tempest-VolumesSnapshotTestJSON-579482592-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:07:58.864107 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-55ae0763-46ce-4aa8-9a19-1ab137cde578 tempest-VolumesSnapshotTestJSON-579482592 tempest-VolumesSnapshotTestJSON-579482592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9538a349ca91455f818e1b9d7758f400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a4d189a97b441ea2790d04daa79853', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 21:07:58.872239 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-55ae0763-46ce-4aa8-9a19-1ab137cde578 tempest-VolumesSnapshotTestJSON-579482592 tempest-VolumesSnapshotTestJSON-579482592-project] 10.222.0.20 "GET /compute/v2.1/servers/e9c39bcf-1003-4e31-8974-024540459277" status: 200 len: 1513 microversion: 2.1 time: 0.151884 Jul 05 21:07:58.872798 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 475/972] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 21:07:58 2022] GET /compute/v2.1/servers/e9c39bcf-1003-4e31-8974-024540459277 => generated 1513 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 21:07:59.658865 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [req-11a0dd66-dd15-4c6f-9afc-93b2fde74142 req-eec7f0c3-e6ba-49d2-9493-83a44b1df376 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9c39bcf-1003-4e31-8974-024540459277", "name": "network-vif-deleted", "tag": "afd3830b-3253-4ce8-b5de-88eab125141e"}]} {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 21:07:59.668538 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [req-11a0dd66-dd15-4c6f-9afc-93b2fde74142 req-eec7f0c3-e6ba-49d2-9493-83a44b1df376 service nova] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:07:59.669030 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [req-11a0dd66-dd15-4c6f-9afc-93b2fde74142 req-eec7f0c3-e6ba-49d2-9493-83a44b1df376 service nova] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:07:59.680172 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.compute.server_external_events [req-11a0dd66-dd15-4c6f-9afc-93b2fde74142 req-eec7f0c3-e6ba-49d2-9493-83a44b1df376 service nova] Creating event network-vif-deleted:afd3830b-3253-4ce8-b5de-88eab125141e for instance e9c39bcf-1003-4e31-8974-024540459277 on hv-cinder-79760 Jul 05 21:07:59.685611 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [req-11a0dd66-dd15-4c6f-9afc-93b2fde74142 req-eec7f0c3-e6ba-49d2-9493-83a44b1df376 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030452 Jul 05 21:07:59.686414 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 498/973] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 5 21:07:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 21:07:59.890898 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-839d1077-cf26-403c-8686-e9bd1e05d1fb tempest-VolumesSnapshotTestJSON-579482592 tempest-VolumesSnapshotTestJSON-579482592-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 21:07:59.891620 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-839d1077-cf26-403c-8686-e9bd1e05d1fb tempest-VolumesSnapshotTestJSON-579482592 tempest-VolumesSnapshotTestJSON-579482592-project] [instance: e9c39bcf-1003-4e31-8974-024540459277] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 21:07:59.898448 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-839d1077-cf26-403c-8686-e9bd1e05d1fb tempest-VolumesSnapshotTestJSON-579482592 tempest-VolumesSnapshotTestJSON-579482592-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:07:59.898901 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-839d1077-cf26-403c-8686-e9bd1e05d1fb tempest-VolumesSnapshotTestJSON-579482592 tempest-VolumesSnapshotTestJSON-579482592-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:07:59.899824 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-839d1077-cf26-403c-8686-e9bd1e05d1fb tempest-VolumesSnapshotTestJSON-579482592 tempest-VolumesSnapshotTestJSON-579482592-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:07:59.900268 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-839d1077-cf26-403c-8686-e9bd1e05d1fb tempest-VolumesSnapshotTestJSON-579482592 tempest-VolumesSnapshotTestJSON-579482592-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:07:59.932313 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-839d1077-cf26-403c-8686-e9bd1e05d1fb tempest-VolumesSnapshotTestJSON-579482592 tempest-VolumesSnapshotTestJSON-579482592-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:07:59.932766 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-839d1077-cf26-403c-8686-e9bd1e05d1fb tempest-VolumesSnapshotTestJSON-579482592 tempest-VolumesSnapshotTestJSON-579482592-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:07:59.933254 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.objects.instance [None req-839d1077-cf26-403c-8686-e9bd1e05d1fb tempest-VolumesSnapshotTestJSON-579482592 tempest-VolumesSnapshotTestJSON-579482592-project] Lazy-loading 'fault' on Instance uuid e9c39bcf-1003-4e31-8974-024540459277 {{(pid=117627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 05 21:07:59.975179 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-839d1077-cf26-403c-8686-e9bd1e05d1fb tempest-VolumesSnapshotTestJSON-579482592 tempest-VolumesSnapshotTestJSON-579482592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9538a349ca91455f818e1b9d7758f400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a4d189a97b441ea2790d04daa79853', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 21:07:59.982926 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-839d1077-cf26-403c-8686-e9bd1e05d1fb tempest-VolumesSnapshotTestJSON-579482592 tempest-VolumesSnapshotTestJSON-579482592-project] 10.222.0.20 "GET /compute/v2.1/servers/e9c39bcf-1003-4e31-8974-024540459277" status: 200 len: 1309 microversion: 2.1 time: 0.096719 Jul 05 21:07:59.983476 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 476/974] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 21:07:59 2022] GET /compute/v2.1/servers/e9c39bcf-1003-4e31-8974-024540459277 => generated 1309 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 21:08:01.001175 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-06227eda-d2ab-4670-bc52-bbe3df78badd tempest-VolumesSnapshotTestJSON-579482592 tempest-VolumesSnapshotTestJSON-579482592-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 21:08:01.001861 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-06227eda-d2ab-4670-bc52-bbe3df78badd tempest-VolumesSnapshotTestJSON-579482592 tempest-VolumesSnapshotTestJSON-579482592-project] [instance: e9c39bcf-1003-4e31-8974-024540459277] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 21:08:01.008482 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-06227eda-d2ab-4670-bc52-bbe3df78badd tempest-VolumesSnapshotTestJSON-579482592 tempest-VolumesSnapshotTestJSON-579482592-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:08:01.009614 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-06227eda-d2ab-4670-bc52-bbe3df78badd tempest-VolumesSnapshotTestJSON-579482592 tempest-VolumesSnapshotTestJSON-579482592-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:08:01.010381 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-06227eda-d2ab-4670-bc52-bbe3df78badd tempest-VolumesSnapshotTestJSON-579482592 tempest-VolumesSnapshotTestJSON-579482592-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:08:01.010808 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-06227eda-d2ab-4670-bc52-bbe3df78badd tempest-VolumesSnapshotTestJSON-579482592 tempest-VolumesSnapshotTestJSON-579482592-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:08:01.025325 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.wsgi [None req-06227eda-d2ab-4670-bc52-bbe3df78badd tempest-VolumesSnapshotTestJSON-579482592 tempest-VolumesSnapshotTestJSON-579482592-project] HTTP exception thrown: Instance e9c39bcf-1003-4e31-8974-024540459277 could not be found. Jul 05 21:08:01.027383 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-06227eda-d2ab-4670-bc52-bbe3df78badd tempest-VolumesSnapshotTestJSON-579482592 tempest-VolumesSnapshotTestJSON-579482592-project] Request method failure captured: Jul 05 21:08:01.027383 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: request: GET /compute/v2.1/servers/e9c39bcf-1003-4e31-8974-024540459277 HTTP/1.1 Jul 05 21:08:01.027383 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: Accept: application/json Jul 05 21:08:01.027383 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: Accept-Encoding: identity Jul 05 21:08:01.027383 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: Connection: close Jul 05 21:08:01.027383 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: Content-Length: 0 Jul 05 21:08:01.027383 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: Content-Type: application/json Jul 05 21:08:01.027383 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: Host: 10.222.0.20 Jul 05 21:08:01.027383 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: Openstack-System-Scope: None Jul 05 21:08:01.027383 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: User-Agent: python-urllib3/1.26.9 Jul 05 21:08:01.027383 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Auth-Token: gAAAAABixKfWiRwBPqJAWUIX9YNwhH_7vW4EinaBDssYZMT8rGKRvjL-7KgsJp7cgm4QME5lKfEiFaCtduv1ReBVMYccCufo5XrSYAh4-fOEma9VrSmIX7b9EcY2kEKGndhvsQ8bA6OAbyPMUMW4i1YMIyiSite2xd-rqEqEc3U7fwfddhNiAFY Jul 05 21:08:01.027383 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Domain-Id: None Jul 05 21:08:01.027383 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Domain-Name: None Jul 05 21:08:01.027383 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Identity-Status: Confirmed Jul 05 21:08:01.027383 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Is-Admin-Project: True Jul 05 21:08:01.027383 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Project-Domain-Id: default Jul 05 21:08:01.027383 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Project-Domain-Name: Default Jul 05 21:08:01.027383 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Project-Id: c4a4d189a97b441ea2790d04daa79853 Jul 05 21:08:01.027383 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Project-Name: tempest-VolumesSnapshotTestJSON-579482592 Jul 05 21:08:01.027383 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Role: member,reader Jul 05 21:08:01.027383 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Roles: member,reader Jul 05 21:08:01.029905 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c4a4d189a97b441ea2790d04daa79853"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/c4a4d189a97b441ea2790d04daa79853"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_c4a4d189a97b441ea2790d04daa79853"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c4a4d189a97b441ea2790d04daa79853"}]}] Jul 05 21:08:01.029905 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Tenant: tempest-VolumesSnapshotTestJSON-579482592 Jul 05 21:08:01.029905 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Tenant-Id: c4a4d189a97b441ea2790d04daa79853 Jul 05 21:08:01.029905 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-579482592 Jul 05 21:08:01.029905 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-User: tempest-VolumesSnapshotTestJSON-579482592-project Jul 05 21:08:01.029905 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-User-Domain-Id: default Jul 05 21:08:01.029905 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-User-Domain-Name: Default Jul 05 21:08:01.029905 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-User-Id: 9538a349ca91455f818e1b9d7758f400 Jul 05 21:08:01.029905 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-User-Name: tempest-VolumesSnapshotTestJSON-579482592-project Jul 05 21:08:01.029905 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: method: > Jul 05 21:08:01.029905 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: exception: Instance e9c39bcf-1003-4e31-8974-024540459277 could not be found. Jul 05 21:08:01.029905 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: action_args: {'id': 'e9c39bcf-1003-4e31-8974-024540459277'} Jul 05 21:08:01.031488 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 05 21:08:01.031488 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 21:08:01.031488 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 05 21:08:01.031488 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 05 21:08:01.031488 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 05 21:08:01.031488 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 05 21:08:01.031488 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 05 21:08:01.031488 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 05 21:08:01.031488 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 05 21:08:01.031488 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 05 21:08:01.031488 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e9c39bcf-1003-4e31-8974-024540459277 could not be found. Jul 05 21:08:01.031488 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi Jul 05 21:08:01.031488 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 21:08:01.031488 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi Jul 05 21:08:01.031488 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 21:08:01.031488 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 21:08:01.031488 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 21:08:01.031488 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 05 21:08:01.031488 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 05 21:08:01.031488 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 05 21:08:01.033519 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 05 21:08:01.033519 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 05 21:08:01.033519 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 05 21:08:01.033519 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 05 21:08:01.033519 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 05 21:08:01.033519 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 05 21:08:01.033519 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 05 21:08:01.033519 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e9c39bcf-1003-4e31-8974-024540459277 could not be found. Jul 05 21:08:01.033519 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi Jul 05 21:08:01.033519 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 21:08:01.033519 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi Jul 05 21:08:01.033519 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 21:08:01.033519 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 21:08:01.033519 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 21:08:01.033519 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 05 21:08:01.033519 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 05 21:08:01.033519 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e9c39bcf-1003-4e31-8974-024540459277 could not be found. Jul 05 21:08:01.033519 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi Jul 05 21:08:01.035148 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-06227eda-d2ab-4670-bc52-bbe3df78badd tempest-VolumesSnapshotTestJSON-579482592 tempest-VolumesSnapshotTestJSON-579482592-project] Returning 404 to user: Instance e9c39bcf-1003-4e31-8974-024540459277 could not be found. {{(pid=117628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 05 21:08:01.035148 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-06227eda-d2ab-4670-bc52-bbe3df78badd tempest-VolumesSnapshotTestJSON-579482592 tempest-VolumesSnapshotTestJSON-579482592-project] 10.222.0.20 "GET /compute/v2.1/servers/e9c39bcf-1003-4e31-8974-024540459277" status: 404 len: 111 microversion: 2.1 time: 0.032466 Jul 05 21:08:01.035148 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 499/975] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 21:08:00 2022] GET /compute/v2.1/servers/e9c39bcf-1003-4e31-8974-024540459277 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 05 21:08:42.062628 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-4d8d8f5a-eac9-4132-b87c-d7d70f79de0a tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] Action: 'create', calling method: .version_select at 0x7f57cdeba670>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-142085630", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDftEj6qjNvT6GGlmm7PC2jP3fTiNKbPE4mAu2kwhkRDLd8UxP3oIz8kft2aBah3E1pjrnQlfHG0E5gJNJa0DUUDA1NmkcOEsGxEcDHcqGGSSvGbkAjVs9s+Vp04TBhYzA=="}} {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 21:08:42.066917 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG dbcounter [-] [117627] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=117627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:42.067558 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG dbcounter [-] [117627] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:42.083016 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.quota [None req-4d8d8f5a-eac9-4132-b87c-d7d70f79de0a tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] Getting quotas for project 0fd0a48966e24e63a11fc4ee42a10330. Resources: {'key_pairs'} {{(pid=117627) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 05 21:08:42.086833 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.quota [None req-4d8d8f5a-eac9-4132-b87c-d7d70f79de0a tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] Getting quotas for user 8170a0af23d94859adea5840424c4d70 and project 0fd0a48966e24e63a11fc4ee42a10330. Resources: {'key_pairs'} {{(pid=117627) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 05 21:08:42.107996 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-4d8d8f5a-eac9-4132-b87c-d7d70f79de0a tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.049433 Jul 05 21:08:42.108562 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 477/976] 10.222.0.20 () {60 vars in 1158 bytes} [Tue Jul 5 21:08:42 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 21:08:42.157656 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-16cd11f6-14ca-473f-bec2-2444168e2f8f tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1376628732", "imageRef": "03d757e0-203f-4c09-9cef-2aefe58abe78", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-142085630", "networks": [{"uuid": "9afc43b2-9142-4fce-9687-2a5f1570de62"}]}} {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 21:08:42.165318 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG dbcounter [-] [117628] Writing DB stats nova_api:SELECT=8 {{(pid=117628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:42.165977 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG dbcounter [-] [117628] Writing DB stats nova_cell1:SELECT=19,nova_cell1:INSERT=1 {{(pid=117628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:42.210231 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.network.neutron [None req-16cd11f6-14ca-473f-bec2-2444168e2f8f tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] validate_networks() for [('9afc43b2-9142-4fce-9687-2a5f1570de62', None, None, None, None, None)] {{(pid=117628) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 05 21:08:42.580246 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.virt.hardware [None req-16cd11f6-14ca-473f-bec2-2444168e2f8f tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] Flavor limits 0:0:0 {{(pid=117628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 05 21:08:42.580573 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.virt.hardware [None req-16cd11f6-14ca-473f-bec2-2444168e2f8f tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] Image limits 0:0:0 {{(pid=117628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 05 21:08:42.581039 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.virt.hardware [None req-16cd11f6-14ca-473f-bec2-2444168e2f8f tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] Flavor pref 0:0:0 {{(pid=117628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 05 21:08:42.581441 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.virt.hardware [None req-16cd11f6-14ca-473f-bec2-2444168e2f8f tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] Image pref 0:0:0 {{(pid=117628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 05 21:08:42.581841 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.virt.hardware [None req-16cd11f6-14ca-473f-bec2-2444168e2f8f tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 05 21:08:42.591261 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-16cd11f6-14ca-473f-bec2-2444168e2f8f tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:08:42.591701 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-16cd11f6-14ca-473f-bec2-2444168e2f8f tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:08:42.592611 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-16cd11f6-14ca-473f-bec2-2444168e2f8f tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:08:42.592954 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-16cd11f6-14ca-473f-bec2-2444168e2f8f tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:08:42.609602 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.quota [None req-16cd11f6-14ca-473f-bec2-2444168e2f8f tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] Getting quotas for project 0fd0a48966e24e63a11fc4ee42a10330. Resources: {'cores', 'ram', 'instances'} {{(pid=117628) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 05 21:08:42.613849 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.quota [None req-16cd11f6-14ca-473f-bec2-2444168e2f8f tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] Getting quotas for user 8170a0af23d94859adea5840424c4d70 and project 0fd0a48966e24e63a11fc4ee42a10330. Resources: {'cores', 'ram', 'instances'} {{(pid=117628) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 05 21:08:42.627305 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-16cd11f6-14ca-473f-bec2-2444168e2f8f tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] Going to run 1 instances... {{(pid=117628) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 05 21:08:42.630063 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-16cd11f6-14ca-473f-bec2-2444168e2f8f tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] [instance: 6a2f4c8c-e968-41e4-9aa8-37cadd75f829] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='03d757e0-203f-4c09-9cef-2aefe58abe78',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117628) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 05 21:08:42.674123 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-16cd11f6-14ca-473f-bec2-2444168e2f8f tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.520294 Jul 05 21:08:42.674756 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 500/977] 10.222.0.20 () {60 vars in 1146 bytes} [Tue Jul 5 21:08:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 522 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 05 21:08:42.685873 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-08691997-fe42-4582-a6eb-72ed2067c3bd tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 21:08:42.686484 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-08691997-fe42-4582-a6eb-72ed2067c3bd tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] [instance: 6a2f4c8c-e968-41e4-9aa8-37cadd75f829] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 21:08:42.745247 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-08691997-fe42-4582-a6eb-72ed2067c3bd tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8170a0af23d94859adea5840424c4d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fd0a48966e24e63a11fc4ee42a10330', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 21:08:42.751847 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-08691997-fe42-4582-a6eb-72ed2067c3bd tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] 10.222.0.20 "GET /compute/v2.1/servers/6a2f4c8c-e968-41e4-9aa8-37cadd75f829" status: 200 len: 1258 microversion: 2.1 time: 0.070500 Jul 05 21:08:42.752429 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 478/978] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 21:08:42 2022] GET /compute/v2.1/servers/6a2f4c8c-e968-41e4-9aa8-37cadd75f829 => generated 1258 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 21:08:43.770099 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-3fac9057-4a03-41a7-96d8-2a68fbd03d65 tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 21:08:43.770708 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-3fac9057-4a03-41a7-96d8-2a68fbd03d65 tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] [instance: 6a2f4c8c-e968-41e4-9aa8-37cadd75f829] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 21:08:43.778978 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-3fac9057-4a03-41a7-96d8-2a68fbd03d65 tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:08:43.779632 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-3fac9057-4a03-41a7-96d8-2a68fbd03d65 tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:08:43.780838 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-3fac9057-4a03-41a7-96d8-2a68fbd03d65 tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:08:43.781579 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-3fac9057-4a03-41a7-96d8-2a68fbd03d65 tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:08:43.876415 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-3fac9057-4a03-41a7-96d8-2a68fbd03d65 tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8170a0af23d94859adea5840424c4d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fd0a48966e24e63a11fc4ee42a10330', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 21:08:43.884466 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-3fac9057-4a03-41a7-96d8-2a68fbd03d65 tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] 10.222.0.20 "GET /compute/v2.1/servers/6a2f4c8c-e968-41e4-9aa8-37cadd75f829" status: 200 len: 1316 microversion: 2.1 time: 0.118920 Jul 05 21:08:43.885512 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 501/979] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 21:08:43 2022] GET /compute/v2.1/servers/6a2f4c8c-e968-41e4-9aa8-37cadd75f829 => generated 1316 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 21:08:44.903774 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-b02dad36-8d38-4fea-bfed-526dcad3bffc tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 21:08:44.904360 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-b02dad36-8d38-4fea-bfed-526dcad3bffc tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] [instance: 6a2f4c8c-e968-41e4-9aa8-37cadd75f829] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 21:08:44.912442 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-b02dad36-8d38-4fea-bfed-526dcad3bffc tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:08:44.912828 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-b02dad36-8d38-4fea-bfed-526dcad3bffc tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:08:44.913630 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-b02dad36-8d38-4fea-bfed-526dcad3bffc tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:08:44.914070 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-b02dad36-8d38-4fea-bfed-526dcad3bffc tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:08:45.121173 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-b02dad36-8d38-4fea-bfed-526dcad3bffc tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8170a0af23d94859adea5840424c4d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fd0a48966e24e63a11fc4ee42a10330', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 21:08:45.134140 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-b02dad36-8d38-4fea-bfed-526dcad3bffc tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] 10.222.0.20 "GET /compute/v2.1/servers/6a2f4c8c-e968-41e4-9aa8-37cadd75f829" status: 200 len: 1358 microversion: 2.1 time: 0.235603 Jul 05 21:08:45.144249 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 479/980] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 21:08:44 2022] GET /compute/v2.1/servers/6a2f4c8c-e968-41e4-9aa8-37cadd75f829 => generated 1358 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 21:08:46.152018 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-3612256a-57fe-4d98-be61-86b885945a1c tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 21:08:46.153390 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-3612256a-57fe-4d98-be61-86b885945a1c tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] [instance: 6a2f4c8c-e968-41e4-9aa8-37cadd75f829] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 21:08:46.160686 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-3612256a-57fe-4d98-be61-86b885945a1c tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:08:46.161190 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-3612256a-57fe-4d98-be61-86b885945a1c tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:08:46.162149 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-3612256a-57fe-4d98-be61-86b885945a1c tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:08:46.162574 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-3612256a-57fe-4d98-be61-86b885945a1c tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:08:46.304361 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-3612256a-57fe-4d98-be61-86b885945a1c tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8170a0af23d94859adea5840424c4d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fd0a48966e24e63a11fc4ee42a10330', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 21:08:46.313118 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-3612256a-57fe-4d98-be61-86b885945a1c tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] 10.222.0.20 "GET /compute/v2.1/servers/6a2f4c8c-e968-41e4-9aa8-37cadd75f829" status: 200 len: 1358 microversion: 2.1 time: 0.165337 Jul 05 21:08:46.313825 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 502/981] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 21:08:46 2022] GET /compute/v2.1/servers/6a2f4c8c-e968-41e4-9aa8-37cadd75f829 => generated 1358 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 21:08:47.330070 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-68860c4f-33c4-487f-830e-525d250fb4fe tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 21:08:47.330761 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-68860c4f-33c4-487f-830e-525d250fb4fe tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] [instance: 6a2f4c8c-e968-41e4-9aa8-37cadd75f829] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 21:08:47.337726 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-68860c4f-33c4-487f-830e-525d250fb4fe tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:08:47.338934 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-68860c4f-33c4-487f-830e-525d250fb4fe tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:08:47.339924 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-68860c4f-33c4-487f-830e-525d250fb4fe tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:08:47.340362 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-68860c4f-33c4-487f-830e-525d250fb4fe tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:08:47.483018 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-68860c4f-33c4-487f-830e-525d250fb4fe tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8170a0af23d94859adea5840424c4d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fd0a48966e24e63a11fc4ee42a10330', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 21:08:47.490744 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-68860c4f-33c4-487f-830e-525d250fb4fe tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] 10.222.0.20 "GET /compute/v2.1/servers/6a2f4c8c-e968-41e4-9aa8-37cadd75f829" status: 200 len: 1358 microversion: 2.1 time: 0.164506 Jul 05 21:08:47.491681 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 480/982] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 21:08:47 2022] GET /compute/v2.1/servers/6a2f4c8c-e968-41e4-9aa8-37cadd75f829 => generated 1358 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 21:08:48.512157 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-a5e07569-743c-4603-b914-96a964a57437 tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 21:08:48.513578 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-a5e07569-743c-4603-b914-96a964a57437 tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] [instance: 6a2f4c8c-e968-41e4-9aa8-37cadd75f829] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 21:08:48.522166 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-a5e07569-743c-4603-b914-96a964a57437 tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:08:48.523093 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-a5e07569-743c-4603-b914-96a964a57437 tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:08:48.524212 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-a5e07569-743c-4603-b914-96a964a57437 tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:08:48.525159 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-a5e07569-743c-4603-b914-96a964a57437 tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:08:48.672213 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-a5e07569-743c-4603-b914-96a964a57437 tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8170a0af23d94859adea5840424c4d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fd0a48966e24e63a11fc4ee42a10330', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 21:08:48.677473 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-a5e07569-743c-4603-b914-96a964a57437 tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] 10.222.0.20 "GET /compute/v2.1/servers/6a2f4c8c-e968-41e4-9aa8-37cadd75f829" status: 200 len: 1358 microversion: 2.1 time: 0.170774 Jul 05 21:08:48.678042 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 503/983] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 21:08:48 2022] GET /compute/v2.1/servers/6a2f4c8c-e968-41e4-9aa8-37cadd75f829 => generated 1358 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 21:08:49.696571 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-b93530ce-fe9e-4ad1-91f7-d0923847daaf tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 21:08:49.697590 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-b93530ce-fe9e-4ad1-91f7-d0923847daaf tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] [instance: 6a2f4c8c-e968-41e4-9aa8-37cadd75f829] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 21:08:49.706059 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-b93530ce-fe9e-4ad1-91f7-d0923847daaf tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:08:49.706618 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-b93530ce-fe9e-4ad1-91f7-d0923847daaf tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:08:49.707463 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-b93530ce-fe9e-4ad1-91f7-d0923847daaf tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:08:49.708877 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-b93530ce-fe9e-4ad1-91f7-d0923847daaf tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:08:49.865285 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-b93530ce-fe9e-4ad1-91f7-d0923847daaf tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8170a0af23d94859adea5840424c4d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fd0a48966e24e63a11fc4ee42a10330', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 21:08:49.875033 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-b93530ce-fe9e-4ad1-91f7-d0923847daaf tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] 10.222.0.20 "GET /compute/v2.1/servers/6a2f4c8c-e968-41e4-9aa8-37cadd75f829" status: 200 len: 1358 microversion: 2.1 time: 0.182362 Jul 05 21:08:49.875812 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 481/984] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 21:08:49 2022] GET /compute/v2.1/servers/6a2f4c8c-e968-41e4-9aa8-37cadd75f829 => generated 1358 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 21:08:50.891709 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-3108dc13-8f69-4947-b4d8-3374e57fef1e tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 21:08:50.892405 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-3108dc13-8f69-4947-b4d8-3374e57fef1e tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] [instance: 6a2f4c8c-e968-41e4-9aa8-37cadd75f829] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 21:08:50.899483 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-3108dc13-8f69-4947-b4d8-3374e57fef1e tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:08:50.899932 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-3108dc13-8f69-4947-b4d8-3374e57fef1e tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:08:50.901431 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-3108dc13-8f69-4947-b4d8-3374e57fef1e tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:08:50.901929 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-3108dc13-8f69-4947-b4d8-3374e57fef1e tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:08:51.050273 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-3108dc13-8f69-4947-b4d8-3374e57fef1e tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8170a0af23d94859adea5840424c4d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fd0a48966e24e63a11fc4ee42a10330', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 21:08:51.058816 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-3108dc13-8f69-4947-b4d8-3374e57fef1e tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] 10.222.0.20 "GET /compute/v2.1/servers/6a2f4c8c-e968-41e4-9aa8-37cadd75f829" status: 200 len: 1358 microversion: 2.1 time: 0.170784 Jul 05 21:08:51.068044 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 504/985] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 21:08:50 2022] GET /compute/v2.1/servers/6a2f4c8c-e968-41e4-9aa8-37cadd75f829 => generated 1358 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 21:08:52.075879 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-d8236c8e-0b2b-414e-8123-85a498314e1a tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 21:08:52.076523 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-d8236c8e-0b2b-414e-8123-85a498314e1a tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] [instance: 6a2f4c8c-e968-41e4-9aa8-37cadd75f829] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 21:08:52.083440 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-d8236c8e-0b2b-414e-8123-85a498314e1a tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:08:52.083888 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-d8236c8e-0b2b-414e-8123-85a498314e1a tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:08:52.084652 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-d8236c8e-0b2b-414e-8123-85a498314e1a tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:08:52.085120 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-d8236c8e-0b2b-414e-8123-85a498314e1a tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:08:52.316220 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-d8236c8e-0b2b-414e-8123-85a498314e1a tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8170a0af23d94859adea5840424c4d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fd0a48966e24e63a11fc4ee42a10330', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 21:08:52.324513 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-d8236c8e-0b2b-414e-8123-85a498314e1a tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] 10.222.0.20 "GET /compute/v2.1/servers/6a2f4c8c-e968-41e4-9aa8-37cadd75f829" status: 200 len: 1358 microversion: 2.1 time: 0.252689 Jul 05 21:08:52.333547 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 482/986] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 21:08:52 2022] GET /compute/v2.1/servers/6a2f4c8c-e968-41e4-9aa8-37cadd75f829 => generated 1358 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 21:08:52.474979 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [req-4fd10792-cd6f-4035-a590-a4a8907ef607 req-c152988c-11a1-46e8-9848-4de58a767ead service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6a2f4c8c-e968-41e4-9aa8-37cadd75f829", "tag": "62999338-920c-4286-a36a-9a00c662f6da"}]} {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 21:08:52.486237 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [req-4fd10792-cd6f-4035-a590-a4a8907ef607 req-c152988c-11a1-46e8-9848-4de58a767ead service nova] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:08:52.486764 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [req-4fd10792-cd6f-4035-a590-a4a8907ef607 req-c152988c-11a1-46e8-9848-4de58a767ead service nova] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:08:52.500403 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.compute.server_external_events [req-4fd10792-cd6f-4035-a590-a4a8907ef607 req-c152988c-11a1-46e8-9848-4de58a767ead service nova] Creating event network-changed:62999338-920c-4286-a36a-9a00c662f6da for instance 6a2f4c8c-e968-41e4-9aa8-37cadd75f829 on hv-cinder-79760 Jul 05 21:08:52.505420 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [req-4fd10792-cd6f-4035-a590-a4a8907ef607 req-c152988c-11a1-46e8-9848-4de58a767ead service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034063 Jul 05 21:08:52.506006 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 505/987] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 5 21:08:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 05 21:08:53.341650 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-2caf37f4-ddb8-4819-8336-e5d3608e2016 tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 21:08:53.342283 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-2caf37f4-ddb8-4819-8336-e5d3608e2016 tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] [instance: 6a2f4c8c-e968-41e4-9aa8-37cadd75f829] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 21:08:53.344097 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG dbcounter [-] [117627] Writing DB stats nova_cell0:SELECT=6 {{(pid=117627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:53.350308 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-2caf37f4-ddb8-4819-8336-e5d3608e2016 tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:08:53.350761 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-2caf37f4-ddb8-4819-8336-e5d3608e2016 tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:08:53.351500 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-2caf37f4-ddb8-4819-8336-e5d3608e2016 tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:08:53.351926 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-2caf37f4-ddb8-4819-8336-e5d3608e2016 tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:08:53.481316 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-2caf37f4-ddb8-4819-8336-e5d3608e2016 tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8170a0af23d94859adea5840424c4d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fd0a48966e24e63a11fc4ee42a10330', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 21:08:53.488712 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-2caf37f4-ddb8-4819-8336-e5d3608e2016 tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] 10.222.0.20 "GET /compute/v2.1/servers/6a2f4c8c-e968-41e4-9aa8-37cadd75f829" status: 200 len: 1358 microversion: 2.1 time: 0.151458 Jul 05 21:08:53.489291 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 483/988] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 21:08:53 2022] GET /compute/v2.1/servers/6a2f4c8c-e968-41e4-9aa8-37cadd75f829 => generated 1358 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 21:08:54.503760 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG dbcounter [-] [117628] Writing DB stats nova_cell0:SELECT=2 {{(pid=117628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:54.504514 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG dbcounter [-] [117628] Writing DB stats nova_cell0:SELECT=6 {{(pid=117628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:54.509440 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-596a23b5-9188-4cd5-9e3a-4fc4330c6416 tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 21:08:54.510255 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-596a23b5-9188-4cd5-9e3a-4fc4330c6416 tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] [instance: 6a2f4c8c-e968-41e4-9aa8-37cadd75f829] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 21:08:54.517255 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-596a23b5-9188-4cd5-9e3a-4fc4330c6416 tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:08:54.517703 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-596a23b5-9188-4cd5-9e3a-4fc4330c6416 tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:08:54.518453 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-596a23b5-9188-4cd5-9e3a-4fc4330c6416 tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:08:54.518878 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-596a23b5-9188-4cd5-9e3a-4fc4330c6416 tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:08:54.651748 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-596a23b5-9188-4cd5-9e3a-4fc4330c6416 tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8170a0af23d94859adea5840424c4d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fd0a48966e24e63a11fc4ee42a10330', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 21:08:54.659128 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-596a23b5-9188-4cd5-9e3a-4fc4330c6416 tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] 10.222.0.20 "GET /compute/v2.1/servers/6a2f4c8c-e968-41e4-9aa8-37cadd75f829" status: 200 len: 1358 microversion: 2.1 time: 0.156325 Jul 05 21:08:54.659682 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 506/989] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 21:08:54 2022] GET /compute/v2.1/servers/6a2f4c8c-e968-41e4-9aa8-37cadd75f829 => generated 1358 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 21:08:55.677099 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-f041f3be-42a8-4e26-b587-6662cbdbd631 tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 21:08:55.677688 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-f041f3be-42a8-4e26-b587-6662cbdbd631 tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] [instance: 6a2f4c8c-e968-41e4-9aa8-37cadd75f829] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 21:08:55.684938 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-f041f3be-42a8-4e26-b587-6662cbdbd631 tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:08:55.685398 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-f041f3be-42a8-4e26-b587-6662cbdbd631 tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:08:55.686154 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-f041f3be-42a8-4e26-b587-6662cbdbd631 tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:08:55.686590 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-f041f3be-42a8-4e26-b587-6662cbdbd631 tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:08:55.814946 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-f041f3be-42a8-4e26-b587-6662cbdbd631 tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8170a0af23d94859adea5840424c4d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fd0a48966e24e63a11fc4ee42a10330', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 21:08:55.822932 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-f041f3be-42a8-4e26-b587-6662cbdbd631 tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] 10.222.0.20 "GET /compute/v2.1/servers/6a2f4c8c-e968-41e4-9aa8-37cadd75f829" status: 200 len: 1358 microversion: 2.1 time: 0.149110 Jul 05 21:08:55.823592 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 484/990] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 21:08:55 2022] GET /compute/v2.1/servers/6a2f4c8c-e968-41e4-9aa8-37cadd75f829 => generated 1358 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 21:08:56.840301 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-0a412635-6eaf-48d7-b53e-5d76ea98bd53 tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 21:08:56.841029 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-0a412635-6eaf-48d7-b53e-5d76ea98bd53 tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] [instance: 6a2f4c8c-e968-41e4-9aa8-37cadd75f829] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 21:08:56.847843 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-0a412635-6eaf-48d7-b53e-5d76ea98bd53 tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:08:56.848300 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-0a412635-6eaf-48d7-b53e-5d76ea98bd53 tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:08:56.849111 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-0a412635-6eaf-48d7-b53e-5d76ea98bd53 tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:08:56.849536 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-0a412635-6eaf-48d7-b53e-5d76ea98bd53 tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:08:56.982109 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-0a412635-6eaf-48d7-b53e-5d76ea98bd53 tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8170a0af23d94859adea5840424c4d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fd0a48966e24e63a11fc4ee42a10330', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 21:08:56.989575 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-0a412635-6eaf-48d7-b53e-5d76ea98bd53 tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] 10.222.0.20 "GET /compute/v2.1/servers/6a2f4c8c-e968-41e4-9aa8-37cadd75f829" status: 200 len: 1358 microversion: 2.1 time: 0.153866 Jul 05 21:08:56.990131 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 507/991] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 21:08:56 2022] GET /compute/v2.1/servers/6a2f4c8c-e968-41e4-9aa8-37cadd75f829 => generated 1358 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 21:08:58.006578 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-9cc7f33f-9cd7-4852-b1b4-8652b2236364 tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 21:08:58.007181 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-9cc7f33f-9cd7-4852-b1b4-8652b2236364 tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] [instance: 6a2f4c8c-e968-41e4-9aa8-37cadd75f829] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 21:08:58.013922 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-9cc7f33f-9cd7-4852-b1b4-8652b2236364 tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:08:58.014402 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-9cc7f33f-9cd7-4852-b1b4-8652b2236364 tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:08:58.015151 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-9cc7f33f-9cd7-4852-b1b4-8652b2236364 tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:08:58.015582 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-9cc7f33f-9cd7-4852-b1b4-8652b2236364 tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:08:58.145366 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-9cc7f33f-9cd7-4852-b1b4-8652b2236364 tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8170a0af23d94859adea5840424c4d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fd0a48966e24e63a11fc4ee42a10330', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 21:08:58.153262 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-9cc7f33f-9cd7-4852-b1b4-8652b2236364 tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] 10.222.0.20 "GET /compute/v2.1/servers/6a2f4c8c-e968-41e4-9aa8-37cadd75f829" status: 200 len: 1358 microversion: 2.1 time: 0.150513 Jul 05 21:08:58.153825 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 485/992] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 21:08:58 2022] GET /compute/v2.1/servers/6a2f4c8c-e968-41e4-9aa8-37cadd75f829 => generated 1358 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 21:08:58.499591 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [req-6ce4f4fd-6b51-420a-a26f-45c10085bd31 req-0bbc2585-30b7-4336-b903-2178bc46a852 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a2f4c8c-e968-41e4-9aa8-37cadd75f829", "name": "network-vif-plugged", "status": "completed", "tag": "62999338-920c-4286-a36a-9a00c662f6da"}]} {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 21:08:58.508542 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [req-6ce4f4fd-6b51-420a-a26f-45c10085bd31 req-0bbc2585-30b7-4336-b903-2178bc46a852 service nova] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:08:58.509128 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [req-6ce4f4fd-6b51-420a-a26f-45c10085bd31 req-0bbc2585-30b7-4336-b903-2178bc46a852 service nova] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:08:58.521582 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.compute.server_external_events [req-6ce4f4fd-6b51-420a-a26f-45c10085bd31 req-0bbc2585-30b7-4336-b903-2178bc46a852 service nova] Creating event network-vif-plugged:62999338-920c-4286-a36a-9a00c662f6da for instance 6a2f4c8c-e968-41e4-9aa8-37cadd75f829 on hv-cinder-79760 Jul 05 21:08:58.527677 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [req-6ce4f4fd-6b51-420a-a26f-45c10085bd31 req-0bbc2585-30b7-4336-b903-2178bc46a852 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033184 Jul 05 21:08:58.528429 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 508/993] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 5 21:08:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 21:08:59.171709 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-1008c291-f38b-47fe-a506-d175b5e78715 tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 21:08:59.172779 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-1008c291-f38b-47fe-a506-d175b5e78715 tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] [instance: 6a2f4c8c-e968-41e4-9aa8-37cadd75f829] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 21:08:59.179967 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-1008c291-f38b-47fe-a506-d175b5e78715 tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:08:59.180409 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-1008c291-f38b-47fe-a506-d175b5e78715 tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:08:59.181287 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-1008c291-f38b-47fe-a506-d175b5e78715 tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:08:59.182553 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-1008c291-f38b-47fe-a506-d175b5e78715 tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:08:59.312599 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-1008c291-f38b-47fe-a506-d175b5e78715 tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8170a0af23d94859adea5840424c4d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fd0a48966e24e63a11fc4ee42a10330', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 21:08:59.319883 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-1008c291-f38b-47fe-a506-d175b5e78715 tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] 10.222.0.20 "GET /compute/v2.1/servers/6a2f4c8c-e968-41e4-9aa8-37cadd75f829" status: 200 len: 1358 microversion: 2.1 time: 0.153911 Jul 05 21:08:59.320430 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 486/994] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 21:08:59 2022] GET /compute/v2.1/servers/6a2f4c8c-e968-41e4-9aa8-37cadd75f829 => generated 1358 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 21:09:00.338585 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-12e9b727-7ca2-4aab-aa31-8a7ac6a434cd tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 21:09:00.339307 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-12e9b727-7ca2-4aab-aa31-8a7ac6a434cd tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] [instance: 6a2f4c8c-e968-41e4-9aa8-37cadd75f829] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 21:09:00.345634 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-12e9b727-7ca2-4aab-aa31-8a7ac6a434cd tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:09:00.346031 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-12e9b727-7ca2-4aab-aa31-8a7ac6a434cd tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:09:00.346796 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-12e9b727-7ca2-4aab-aa31-8a7ac6a434cd tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:09:00.347235 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-12e9b727-7ca2-4aab-aa31-8a7ac6a434cd tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:09:00.474783 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-12e9b727-7ca2-4aab-aa31-8a7ac6a434cd tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8170a0af23d94859adea5840424c4d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fd0a48966e24e63a11fc4ee42a10330', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 21:09:00.482792 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-12e9b727-7ca2-4aab-aa31-8a7ac6a434cd tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] 10.222.0.20 "GET /compute/v2.1/servers/6a2f4c8c-e968-41e4-9aa8-37cadd75f829" status: 200 len: 1548 microversion: 2.1 time: 0.149629 Jul 05 21:09:00.483353 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 509/995] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 21:09:00 2022] GET /compute/v2.1/servers/6a2f4c8c-e968-41e4-9aa8-37cadd75f829 => generated 1548 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 21:09:00.498590 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-f7e42897-2166-4eb9-94a5-61b21e76c749 tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 21:09:00.499333 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-f7e42897-2166-4eb9-94a5-61b21e76c749 tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] [instance: 6a2f4c8c-e968-41e4-9aa8-37cadd75f829] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 21:09:00.505887 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-f7e42897-2166-4eb9-94a5-61b21e76c749 tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:09:00.506331 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-f7e42897-2166-4eb9-94a5-61b21e76c749 tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:09:00.507081 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-f7e42897-2166-4eb9-94a5-61b21e76c749 tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:09:00.507506 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-f7e42897-2166-4eb9-94a5-61b21e76c749 tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:09:00.634923 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-f7e42897-2166-4eb9-94a5-61b21e76c749 tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8170a0af23d94859adea5840424c4d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fd0a48966e24e63a11fc4ee42a10330', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 21:09:00.642529 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-f7e42897-2166-4eb9-94a5-61b21e76c749 tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] 10.222.0.20 "GET /compute/v2.1/servers/6a2f4c8c-e968-41e4-9aa8-37cadd75f829" status: 200 len: 1548 microversion: 2.1 time: 0.147777 Jul 05 21:09:00.643085 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 487/996] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 21:09:00 2022] GET /compute/v2.1/servers/6a2f4c8c-e968-41e4-9aa8-37cadd75f829 => generated 1548 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 21:09:00.658194 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-f68848cd-8ed3-4f3c-9e4e-ceb07e108009 tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 21:09:00.661706 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-f68848cd-8ed3-4f3c-9e4e-ceb07e108009 tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '8170a0af23d94859adea5840424c4d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fd0a48966e24e63a11fc4ee42a10330', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 21:09:00.662461 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-f68848cd-8ed3-4f3c-9e4e-ceb07e108009 tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] Searching by: {'deleted': False, 'project_id': '0fd0a48966e24e63a11fc4ee42a10330'} {{(pid=117628) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 05 21:09:00.669609 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-f68848cd-8ed3-4f3c-9e4e-ceb07e108009 tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:09:00.670053 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-f68848cd-8ed3-4f3c-9e4e-ceb07e108009 tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:09:00.670838 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-f68848cd-8ed3-4f3c-9e4e-ceb07e108009 tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:09:00.671272 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-f68848cd-8ed3-4f3c-9e4e-ceb07e108009 tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:09:00.772033 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.multi_cell_list [None req-f68848cd-8ed3-4f3c-9e4e-ceb07e108009 tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=117628) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 05 21:09:00.864969 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-f68848cd-8ed3-4f3c-9e4e-ceb07e108009 tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] 10.222.0.20 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.210414 Jul 05 21:09:00.865546 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 510/997] 10.222.0.20 () {58 vars in 1124 bytes} [Tue Jul 5 21:09:00 2022] GET /compute/v2.1/servers => generated 343 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 05 21:09:00.875700 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-29a4b9e6-cc0d-41a3-9aee-ea083deb1c80 tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 21:09:00.876308 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-29a4b9e6-cc0d-41a3-9aee-ea083deb1c80 tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] [instance: 6a2f4c8c-e968-41e4-9aa8-37cadd75f829] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 21:09:00.882310 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-29a4b9e6-cc0d-41a3-9aee-ea083deb1c80 tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:09:00.882802 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-29a4b9e6-cc0d-41a3-9aee-ea083deb1c80 tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:09:00.883505 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-29a4b9e6-cc0d-41a3-9aee-ea083deb1c80 tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:09:00.883939 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-29a4b9e6-cc0d-41a3-9aee-ea083deb1c80 tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:09:01.013093 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-29a4b9e6-cc0d-41a3-9aee-ea083deb1c80 tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8170a0af23d94859adea5840424c4d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fd0a48966e24e63a11fc4ee42a10330', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 21:09:01.020790 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-29a4b9e6-cc0d-41a3-9aee-ea083deb1c80 tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] 10.222.0.20 "GET /compute/v2.1/servers/6a2f4c8c-e968-41e4-9aa8-37cadd75f829" status: 200 len: 1548 microversion: 2.1 time: 0.148874 Jul 05 21:09:01.021381 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 488/998] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 21:09:00 2022] GET /compute/v2.1/servers/6a2f4c8c-e968-41e4-9aa8-37cadd75f829 => generated 1548 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 21:09:02.539788 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-a4053b6f-60fd-4e56-8e25-8a499d6a4fdf tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a8af5f3b-3648-49d6-bce3-e0d4e9461499"}} {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 21:09:02.542748 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-a4053b6f-60fd-4e56-8e25-8a499d6a4fdf tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] [instance: 6a2f4c8c-e968-41e4-9aa8-37cadd75f829] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 21:09:02.549230 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-a4053b6f-60fd-4e56-8e25-8a499d6a4fdf tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:09:02.549681 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-a4053b6f-60fd-4e56-8e25-8a499d6a4fdf tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:09:02.550436 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-a4053b6f-60fd-4e56-8e25-8a499d6a4fdf tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:09:02.550872 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-a4053b6f-60fd-4e56-8e25-8a499d6a4fdf tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:09:02.856543 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-a4053b6f-60fd-4e56-8e25-8a499d6a4fdf tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] 10.222.0.20 "POST /compute/v2.1/servers/6a2f4c8c-e968-41e4-9aa8-37cadd75f829/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.320419 Jul 05 21:09:02.857277 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 511/999] 10.222.0.20 () {60 vars in 1322 bytes} [Tue Jul 5 21:09:02 2022] POST /compute/v2.1/servers/6a2f4c8c-e968-41e4-9aa8-37cadd75f829/os-volume_attachments => generated 194 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 21:09:10.402171 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-263bfd05-48d2-4ce6-86ce-3fd55af819b5 tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 21:09:10.402777 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-263bfd05-48d2-4ce6-86ce-3fd55af819b5 tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] [instance: 6a2f4c8c-e968-41e4-9aa8-37cadd75f829] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 21:09:10.409054 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-263bfd05-48d2-4ce6-86ce-3fd55af819b5 tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:09:10.409496 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-263bfd05-48d2-4ce6-86ce-3fd55af819b5 tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:09:10.410244 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-263bfd05-48d2-4ce6-86ce-3fd55af819b5 tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:09:10.410671 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-263bfd05-48d2-4ce6-86ce-3fd55af819b5 tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:09:10.535540 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-263bfd05-48d2-4ce6-86ce-3fd55af819b5 tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8170a0af23d94859adea5840424c4d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fd0a48966e24e63a11fc4ee42a10330', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 21:09:10.544114 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-263bfd05-48d2-4ce6-86ce-3fd55af819b5 tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] 10.222.0.20 "GET /compute/v2.1/servers/6a2f4c8c-e968-41e4-9aa8-37cadd75f829" status: 200 len: 1594 microversion: 2.1 time: 0.146205 Jul 05 21:09:10.544675 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 489/1000] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 21:09:10 2022] GET /compute/v2.1/servers/6a2f4c8c-e968-41e4-9aa8-37cadd75f829 => generated 1594 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 21:09:12.203463 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG dbcounter [-] [117628] Writing DB stats nova_cell0:SELECT=2 {{(pid=117628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:12.209188 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [req-443ae696-a3f8-410c-bbe2-482f12c7641a req-305a74d1-da61-4a82-9821-e7be297f1cb3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6a2f4c8c-e968-41e4-9aa8-37cadd75f829", "tag": "62999338-920c-4286-a36a-9a00c662f6da"}]} {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 21:09:12.218301 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG dbcounter [-] [117628] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=3 {{(pid=117628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:12.221420 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [req-443ae696-a3f8-410c-bbe2-482f12c7641a req-305a74d1-da61-4a82-9821-e7be297f1cb3 service nova] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:09:12.222369 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [req-443ae696-a3f8-410c-bbe2-482f12c7641a req-305a74d1-da61-4a82-9821-e7be297f1cb3 service nova] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:09:12.228058 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG dbcounter [-] [117628] Writing DB stats nova_cell1:SELECT=68,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:12.242350 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.compute.server_external_events [req-443ae696-a3f8-410c-bbe2-482f12c7641a req-305a74d1-da61-4a82-9821-e7be297f1cb3 service nova] Creating event network-changed:62999338-920c-4286-a36a-9a00c662f6da for instance 6a2f4c8c-e968-41e4-9aa8-37cadd75f829 on hv-cinder-79760 Jul 05 21:09:12.247619 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [req-443ae696-a3f8-410c-bbe2-482f12c7641a req-305a74d1-da61-4a82-9821-e7be297f1cb3 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045805 Jul 05 21:09:12.248730 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 512/1001] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 5 21:09:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 21:09:13.390635 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-7a07c9ac-97d9-482a-bbdd-9b09796bf62e tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-946361573"}} {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 21:09:13.391171 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-7a07c9ac-97d9-482a-bbdd-9b09796bf62e tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] [instance: 6a2f4c8c-e968-41e4-9aa8-37cadd75f829] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 21:09:13.393555 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG dbcounter [-] [117627] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=1 {{(pid=117627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:13.399121 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-7a07c9ac-97d9-482a-bbdd-9b09796bf62e tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:09:13.399569 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-7a07c9ac-97d9-482a-bbdd-9b09796bf62e tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:09:13.401245 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-7a07c9ac-97d9-482a-bbdd-9b09796bf62e tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:09:13.401812 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-7a07c9ac-97d9-482a-bbdd-9b09796bf62e tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:09:13.406333 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG dbcounter [-] [117627] Writing DB stats nova_cell1:SELECT=67 {{(pid=117627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:13.527162 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.network.security_group_api [None req-7a07c9ac-97d9-482a-bbdd-9b09796bf62e tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] Adding security group f8de8828-da03-4d13-ae25-e99de65bf6fb to port 62999338-920c-4286-a36a-9a00c662f6da Jul 05 21:09:14.127516 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-7a07c9ac-97d9-482a-bbdd-9b09796bf62e tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] 10.222.0.20 "POST /compute/v2.1/servers/6a2f4c8c-e968-41e4-9aa8-37cadd75f829/action" status: 202 len: 0 microversion: 2.1 time: 0.740776 Jul 05 21:09:14.128300 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 490/1002] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Jul 5 21:09:13 2022] POST /compute/v2.1/servers/6a2f4c8c-e968-41e4-9aa8-37cadd75f829/action => generated 0 bytes in 742 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 05 21:09:14.142323 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-63c22db4-b925-4634-9e88-b8079399332d tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 21:09:14.143046 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-63c22db4-b925-4634-9e88-b8079399332d tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] [instance: 6a2f4c8c-e968-41e4-9aa8-37cadd75f829] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 21:09:14.152918 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-63c22db4-b925-4634-9e88-b8079399332d tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:09:14.153722 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-63c22db4-b925-4634-9e88-b8079399332d tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:09:14.154815 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-63c22db4-b925-4634-9e88-b8079399332d tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:09:14.155412 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-63c22db4-b925-4634-9e88-b8079399332d tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:09:14.264906 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [req-39215aab-028d-4dba-9cbd-7847172b97b4 req-2476b502-7f83-45f0-8183-00185f6a385b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6a2f4c8c-e968-41e4-9aa8-37cadd75f829", "tag": "62999338-920c-4286-a36a-9a00c662f6da"}]} {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 21:09:14.281056 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [req-39215aab-028d-4dba-9cbd-7847172b97b4 req-2476b502-7f83-45f0-8183-00185f6a385b service nova] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:09:14.281497 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [req-39215aab-028d-4dba-9cbd-7847172b97b4 req-2476b502-7f83-45f0-8183-00185f6a385b service nova] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:09:14.298778 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.compute.server_external_events [req-39215aab-028d-4dba-9cbd-7847172b97b4 req-2476b502-7f83-45f0-8183-00185f6a385b service nova] Creating event network-changed:62999338-920c-4286-a36a-9a00c662f6da for instance 6a2f4c8c-e968-41e4-9aa8-37cadd75f829 on hv-cinder-79760 Jul 05 21:09:14.304531 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [req-39215aab-028d-4dba-9cbd-7847172b97b4 req-2476b502-7f83-45f0-8183-00185f6a385b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043253 Jul 05 21:09:14.305599 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 491/1003] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 5 21:09:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 21:09:14.336121 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-63c22db4-b925-4634-9e88-b8079399332d tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8170a0af23d94859adea5840424c4d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fd0a48966e24e63a11fc4ee42a10330', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 21:09:14.348352 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-63c22db4-b925-4634-9e88-b8079399332d tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] 10.222.0.20 "GET /compute/v2.1/servers/6a2f4c8c-e968-41e4-9aa8-37cadd75f829" status: 200 len: 1759 microversion: 2.1 time: 0.214828 Jul 05 21:09:14.349480 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 513/1004] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 21:09:14 2022] GET /compute/v2.1/servers/6a2f4c8c-e968-41e4-9aa8-37cadd75f829 => generated 1759 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 21:09:26.613623 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 05 21:09:26.614226 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: Tue Jul 5 21:09:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 05 21:09:37.034259 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-daadf460-a173-4653-bb48-989a742a723a tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 21:09:37.035202 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-daadf460-a173-4653-bb48-989a742a723a tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] [instance: 6a2f4c8c-e968-41e4-9aa8-37cadd75f829] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 21:09:37.037197 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG dbcounter [-] [117627] Writing DB stats nova_api:SELECT=3 {{(pid=117627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:37.037958 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG dbcounter [-] [117627] Writing DB stats nova_cell1:SELECT=5 {{(pid=117627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:37.044245 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-daadf460-a173-4653-bb48-989a742a723a tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:09:37.044695 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-daadf460-a173-4653-bb48-989a742a723a tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:09:37.045478 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-daadf460-a173-4653-bb48-989a742a723a tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:09:37.045912 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-daadf460-a173-4653-bb48-989a742a723a tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:09:37.121770 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-daadf460-a173-4653-bb48-989a742a723a tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] 10.222.0.20 "POST /compute/v2.1/servers/6a2f4c8c-e968-41e4-9aa8-37cadd75f829/action" status: 202 len: 0 microversion: 2.1 time: 0.091773 Jul 05 21:09:37.122389 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 492/1005] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Jul 5 21:09:37 2022] POST /compute/v2.1/servers/6a2f4c8c-e968-41e4-9aa8-37cadd75f829/action => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 05 21:09:37.130674 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-17d043be-4c93-4834-9d13-8c12f1362e9f tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 21:09:37.131288 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-17d043be-4c93-4834-9d13-8c12f1362e9f tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] [instance: 6a2f4c8c-e968-41e4-9aa8-37cadd75f829] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 21:09:37.134038 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG dbcounter [-] [117628] Writing DB stats nova_api:SELECT=3 {{(pid=117628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:37.135129 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG dbcounter [-] [117628] Writing DB stats nova_cell1:SELECT=7 {{(pid=117628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:37.141627 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-17d043be-4c93-4834-9d13-8c12f1362e9f tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:09:37.142057 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-17d043be-4c93-4834-9d13-8c12f1362e9f tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:09:37.142851 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-17d043be-4c93-4834-9d13-8c12f1362e9f tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:09:37.143291 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-17d043be-4c93-4834-9d13-8c12f1362e9f tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:09:37.499026 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-17d043be-4c93-4834-9d13-8c12f1362e9f tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8170a0af23d94859adea5840424c4d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fd0a48966e24e63a11fc4ee42a10330', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 21:09:37.507459 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-17d043be-4c93-4834-9d13-8c12f1362e9f tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] 10.222.0.20 "GET /compute/v2.1/servers/6a2f4c8c-e968-41e4-9aa8-37cadd75f829" status: 200 len: 1751 microversion: 2.1 time: 0.380652 Jul 05 21:09:37.508032 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 514/1006] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 21:09:37 2022] GET /compute/v2.1/servers/6a2f4c8c-e968-41e4-9aa8-37cadd75f829 => generated 1751 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 21:09:38.526923 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-447f6ade-27f4-4f62-bcbd-cc57618042b1 tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 21:09:38.527613 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-447f6ade-27f4-4f62-bcbd-cc57618042b1 tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] [instance: 6a2f4c8c-e968-41e4-9aa8-37cadd75f829] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 21:09:38.533857 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-447f6ade-27f4-4f62-bcbd-cc57618042b1 tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:09:38.534302 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-447f6ade-27f4-4f62-bcbd-cc57618042b1 tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:09:38.535052 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-447f6ade-27f4-4f62-bcbd-cc57618042b1 tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:09:38.535483 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-447f6ade-27f4-4f62-bcbd-cc57618042b1 tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:09:38.728187 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-447f6ade-27f4-4f62-bcbd-cc57618042b1 tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8170a0af23d94859adea5840424c4d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fd0a48966e24e63a11fc4ee42a10330', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 21:09:38.736216 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-447f6ade-27f4-4f62-bcbd-cc57618042b1 tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] 10.222.0.20 "GET /compute/v2.1/servers/6a2f4c8c-e968-41e4-9aa8-37cadd75f829" status: 200 len: 1756 microversion: 2.1 time: 0.214573 Jul 05 21:09:38.736767 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 493/1007] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 21:09:38 2022] GET /compute/v2.1/servers/6a2f4c8c-e968-41e4-9aa8-37cadd75f829 => generated 1756 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 21:09:39.753359 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-2266409a-6b04-43c9-9855-57f24f26e075 tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 21:09:39.754010 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-2266409a-6b04-43c9-9855-57f24f26e075 tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] [instance: 6a2f4c8c-e968-41e4-9aa8-37cadd75f829] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 21:09:39.760728 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-2266409a-6b04-43c9-9855-57f24f26e075 tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:09:39.761214 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-2266409a-6b04-43c9-9855-57f24f26e075 tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:09:39.761982 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-2266409a-6b04-43c9-9855-57f24f26e075 tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:09:39.762418 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-2266409a-6b04-43c9-9855-57f24f26e075 tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:09:39.902850 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-2266409a-6b04-43c9-9855-57f24f26e075 tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8170a0af23d94859adea5840424c4d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fd0a48966e24e63a11fc4ee42a10330', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 21:09:39.910742 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-2266409a-6b04-43c9-9855-57f24f26e075 tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] 10.222.0.20 "GET /compute/v2.1/servers/6a2f4c8c-e968-41e4-9aa8-37cadd75f829" status: 200 len: 1756 microversion: 2.1 time: 0.161215 Jul 05 21:09:39.911308 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 515/1008] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 21:09:39 2022] GET /compute/v2.1/servers/6a2f4c8c-e968-41e4-9aa8-37cadd75f829 => generated 1756 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 21:09:40.927594 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-5535d029-fa30-4920-ac5b-8e702546a6ef tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 21:09:40.928216 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-5535d029-fa30-4920-ac5b-8e702546a6ef tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] [instance: 6a2f4c8c-e968-41e4-9aa8-37cadd75f829] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 21:09:40.935281 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-5535d029-fa30-4920-ac5b-8e702546a6ef tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:09:40.935742 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-5535d029-fa30-4920-ac5b-8e702546a6ef tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:09:40.936492 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-5535d029-fa30-4920-ac5b-8e702546a6ef tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:09:40.936947 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-5535d029-fa30-4920-ac5b-8e702546a6ef tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:09:41.081855 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-5535d029-fa30-4920-ac5b-8e702546a6ef tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8170a0af23d94859adea5840424c4d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fd0a48966e24e63a11fc4ee42a10330', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 21:09:41.089924 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-5535d029-fa30-4920-ac5b-8e702546a6ef tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] 10.222.0.20 "GET /compute/v2.1/servers/6a2f4c8c-e968-41e4-9aa8-37cadd75f829" status: 200 len: 1756 microversion: 2.1 time: 0.166264 Jul 05 21:09:41.090485 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 494/1009] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 21:09:40 2022] GET /compute/v2.1/servers/6a2f4c8c-e968-41e4-9aa8-37cadd75f829 => generated 1756 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 21:09:42.107002 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-878cd27c-bf28-436f-a0a1-731c5cbaf1e5 tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 21:09:42.107616 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-878cd27c-bf28-436f-a0a1-731c5cbaf1e5 tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] [instance: 6a2f4c8c-e968-41e4-9aa8-37cadd75f829] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 21:09:42.114107 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-878cd27c-bf28-436f-a0a1-731c5cbaf1e5 tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:09:42.114556 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-878cd27c-bf28-436f-a0a1-731c5cbaf1e5 tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:09:42.116191 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-878cd27c-bf28-436f-a0a1-731c5cbaf1e5 tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:09:42.116191 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-878cd27c-bf28-436f-a0a1-731c5cbaf1e5 tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:09:42.260531 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-878cd27c-bf28-436f-a0a1-731c5cbaf1e5 tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8170a0af23d94859adea5840424c4d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fd0a48966e24e63a11fc4ee42a10330', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 21:09:42.268432 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-878cd27c-bf28-436f-a0a1-731c5cbaf1e5 tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] 10.222.0.20 "GET /compute/v2.1/servers/6a2f4c8c-e968-41e4-9aa8-37cadd75f829" status: 200 len: 1756 microversion: 2.1 time: 0.165264 Jul 05 21:09:42.269003 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 516/1010] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 21:09:42 2022] GET /compute/v2.1/servers/6a2f4c8c-e968-41e4-9aa8-37cadd75f829 => generated 1756 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 21:09:43.286385 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-b16ef8ab-cdc2-45ab-b4bf-70e4d947ed67 tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 21:09:43.286999 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-b16ef8ab-cdc2-45ab-b4bf-70e4d947ed67 tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] [instance: 6a2f4c8c-e968-41e4-9aa8-37cadd75f829] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 21:09:43.294166 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-b16ef8ab-cdc2-45ab-b4bf-70e4d947ed67 tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:09:43.294616 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-b16ef8ab-cdc2-45ab-b4bf-70e4d947ed67 tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:09:43.295402 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-b16ef8ab-cdc2-45ab-b4bf-70e4d947ed67 tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:09:43.295838 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-b16ef8ab-cdc2-45ab-b4bf-70e4d947ed67 tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:09:43.438709 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-b16ef8ab-cdc2-45ab-b4bf-70e4d947ed67 tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8170a0af23d94859adea5840424c4d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fd0a48966e24e63a11fc4ee42a10330', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 21:09:43.446669 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-b16ef8ab-cdc2-45ab-b4bf-70e4d947ed67 tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] 10.222.0.20 "GET /compute/v2.1/servers/6a2f4c8c-e968-41e4-9aa8-37cadd75f829" status: 200 len: 1756 microversion: 2.1 time: 0.164040 Jul 05 21:09:43.447395 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 495/1011] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 21:09:43 2022] GET /compute/v2.1/servers/6a2f4c8c-e968-41e4-9aa8-37cadd75f829 => generated 1756 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 21:09:44.464285 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-53516f0a-adf5-47ab-aa36-314522da8149 tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 21:09:44.464907 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-53516f0a-adf5-47ab-aa36-314522da8149 tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] [instance: 6a2f4c8c-e968-41e4-9aa8-37cadd75f829] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 21:09:44.471744 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-53516f0a-adf5-47ab-aa36-314522da8149 tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:09:44.472198 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-53516f0a-adf5-47ab-aa36-314522da8149 tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:09:44.472987 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-53516f0a-adf5-47ab-aa36-314522da8149 tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:09:44.473426 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-53516f0a-adf5-47ab-aa36-314522da8149 tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:09:44.612976 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-53516f0a-adf5-47ab-aa36-314522da8149 tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8170a0af23d94859adea5840424c4d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fd0a48966e24e63a11fc4ee42a10330', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 21:09:44.621026 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-53516f0a-adf5-47ab-aa36-314522da8149 tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] 10.222.0.20 "GET /compute/v2.1/servers/6a2f4c8c-e968-41e4-9aa8-37cadd75f829" status: 200 len: 1756 microversion: 2.1 time: 0.161273 Jul 05 21:09:44.621611 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 517/1012] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 21:09:44 2022] GET /compute/v2.1/servers/6a2f4c8c-e968-41e4-9aa8-37cadd75f829 => generated 1756 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 21:09:45.639491 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-63a97c0c-2ae5-4cf5-8cac-6f1bf22d6378 tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 21:09:45.640079 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-63a97c0c-2ae5-4cf5-8cac-6f1bf22d6378 tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] [instance: 6a2f4c8c-e968-41e4-9aa8-37cadd75f829] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 21:09:45.647088 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-63a97c0c-2ae5-4cf5-8cac-6f1bf22d6378 tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:09:45.647533 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-63a97c0c-2ae5-4cf5-8cac-6f1bf22d6378 tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:09:45.648280 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-63a97c0c-2ae5-4cf5-8cac-6f1bf22d6378 tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:09:45.648709 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-63a97c0c-2ae5-4cf5-8cac-6f1bf22d6378 tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:09:45.788615 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-63a97c0c-2ae5-4cf5-8cac-6f1bf22d6378 tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8170a0af23d94859adea5840424c4d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fd0a48966e24e63a11fc4ee42a10330', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 21:09:45.796658 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-63a97c0c-2ae5-4cf5-8cac-6f1bf22d6378 tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] 10.222.0.20 "GET /compute/v2.1/servers/6a2f4c8c-e968-41e4-9aa8-37cadd75f829" status: 200 len: 1756 microversion: 2.1 time: 0.161063 Jul 05 21:09:45.797242 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 496/1013] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 21:09:45 2022] GET /compute/v2.1/servers/6a2f4c8c-e968-41e4-9aa8-37cadd75f829 => generated 1756 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 21:09:46.813835 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-2d64a6d8-d7c2-4fee-9585-f3b1f6784eca tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 21:09:46.814491 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-2d64a6d8-d7c2-4fee-9585-f3b1f6784eca tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] [instance: 6a2f4c8c-e968-41e4-9aa8-37cadd75f829] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 21:09:46.820904 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-2d64a6d8-d7c2-4fee-9585-f3b1f6784eca tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:09:46.821990 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-2d64a6d8-d7c2-4fee-9585-f3b1f6784eca tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:09:46.822744 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-2d64a6d8-d7c2-4fee-9585-f3b1f6784eca tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:09:46.823174 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-2d64a6d8-d7c2-4fee-9585-f3b1f6784eca tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:09:46.971193 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-2d64a6d8-d7c2-4fee-9585-f3b1f6784eca tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8170a0af23d94859adea5840424c4d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fd0a48966e24e63a11fc4ee42a10330', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 21:09:46.980103 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-2d64a6d8-d7c2-4fee-9585-f3b1f6784eca tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] 10.222.0.20 "GET /compute/v2.1/servers/6a2f4c8c-e968-41e4-9aa8-37cadd75f829" status: 200 len: 1756 microversion: 2.1 time: 0.170048 Jul 05 21:09:46.980670 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 518/1014] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 21:09:46 2022] GET /compute/v2.1/servers/6a2f4c8c-e968-41e4-9aa8-37cadd75f829 => generated 1756 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 21:09:47.997045 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-d2e82ee3-9b19-4a69-84ab-e4d929db4381 tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 21:09:47.997659 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-d2e82ee3-9b19-4a69-84ab-e4d929db4381 tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] [instance: 6a2f4c8c-e968-41e4-9aa8-37cadd75f829] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 21:09:48.004343 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-d2e82ee3-9b19-4a69-84ab-e4d929db4381 tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:09:48.004795 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-d2e82ee3-9b19-4a69-84ab-e4d929db4381 tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:09:48.005595 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-d2e82ee3-9b19-4a69-84ab-e4d929db4381 tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:09:48.006032 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-d2e82ee3-9b19-4a69-84ab-e4d929db4381 tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:09:48.152613 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-d2e82ee3-9b19-4a69-84ab-e4d929db4381 tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8170a0af23d94859adea5840424c4d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fd0a48966e24e63a11fc4ee42a10330', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 21:09:48.160424 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-d2e82ee3-9b19-4a69-84ab-e4d929db4381 tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] 10.222.0.20 "GET /compute/v2.1/servers/6a2f4c8c-e968-41e4-9aa8-37cadd75f829" status: 200 len: 1756 microversion: 2.1 time: 0.167267 Jul 05 21:09:48.160994 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 497/1015] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 21:09:47 2022] GET /compute/v2.1/servers/6a2f4c8c-e968-41e4-9aa8-37cadd75f829 => generated 1756 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 21:09:49.177474 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-56b13bb0-8f08-4eee-bd35-ef64f29f993f tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 21:09:49.178008 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-56b13bb0-8f08-4eee-bd35-ef64f29f993f tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] [instance: 6a2f4c8c-e968-41e4-9aa8-37cadd75f829] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 21:09:49.185114 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-56b13bb0-8f08-4eee-bd35-ef64f29f993f tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:09:49.185564 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-56b13bb0-8f08-4eee-bd35-ef64f29f993f tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:09:49.186351 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-56b13bb0-8f08-4eee-bd35-ef64f29f993f tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:09:49.186770 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-56b13bb0-8f08-4eee-bd35-ef64f29f993f tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:09:49.331517 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-56b13bb0-8f08-4eee-bd35-ef64f29f993f tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8170a0af23d94859adea5840424c4d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fd0a48966e24e63a11fc4ee42a10330', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 21:09:49.339464 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-56b13bb0-8f08-4eee-bd35-ef64f29f993f tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] 10.222.0.20 "GET /compute/v2.1/servers/6a2f4c8c-e968-41e4-9aa8-37cadd75f829" status: 200 len: 1756 microversion: 2.1 time: 0.165879 Jul 05 21:09:49.340024 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 519/1016] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 21:09:49 2022] GET /compute/v2.1/servers/6a2f4c8c-e968-41e4-9aa8-37cadd75f829 => generated 1756 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 21:09:50.356690 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-1ef43af3-cec2-4809-8cd9-ee0f0f3ad688 tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 21:09:50.357314 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-1ef43af3-cec2-4809-8cd9-ee0f0f3ad688 tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] [instance: 6a2f4c8c-e968-41e4-9aa8-37cadd75f829] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 21:09:50.363792 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-1ef43af3-cec2-4809-8cd9-ee0f0f3ad688 tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:09:50.364242 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-1ef43af3-cec2-4809-8cd9-ee0f0f3ad688 tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:09:50.365030 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-1ef43af3-cec2-4809-8cd9-ee0f0f3ad688 tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:09:50.365475 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-1ef43af3-cec2-4809-8cd9-ee0f0f3ad688 tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:09:50.505088 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-1ef43af3-cec2-4809-8cd9-ee0f0f3ad688 tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8170a0af23d94859adea5840424c4d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fd0a48966e24e63a11fc4ee42a10330', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 21:09:50.513970 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-1ef43af3-cec2-4809-8cd9-ee0f0f3ad688 tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] 10.222.0.20 "GET /compute/v2.1/servers/6a2f4c8c-e968-41e4-9aa8-37cadd75f829" status: 200 len: 1756 microversion: 2.1 time: 0.161128 Jul 05 21:09:50.514527 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 498/1017] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 21:09:50 2022] GET /compute/v2.1/servers/6a2f4c8c-e968-41e4-9aa8-37cadd75f829 => generated 1756 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 21:09:51.531467 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-921c18b8-1989-4947-8484-31980ceda6fb tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 21:09:51.532144 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-921c18b8-1989-4947-8484-31980ceda6fb tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] [instance: 6a2f4c8c-e968-41e4-9aa8-37cadd75f829] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 21:09:51.538543 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-921c18b8-1989-4947-8484-31980ceda6fb tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:09:51.538987 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-921c18b8-1989-4947-8484-31980ceda6fb tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:09:51.539754 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-921c18b8-1989-4947-8484-31980ceda6fb tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:09:51.540178 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-921c18b8-1989-4947-8484-31980ceda6fb tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:09:51.685468 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-921c18b8-1989-4947-8484-31980ceda6fb tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8170a0af23d94859adea5840424c4d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fd0a48966e24e63a11fc4ee42a10330', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 21:09:51.693354 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-921c18b8-1989-4947-8484-31980ceda6fb tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] 10.222.0.20 "GET /compute/v2.1/servers/6a2f4c8c-e968-41e4-9aa8-37cadd75f829" status: 200 len: 1756 microversion: 2.1 time: 0.165718 Jul 05 21:09:51.693913 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 520/1018] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 21:09:51 2022] GET /compute/v2.1/servers/6a2f4c8c-e968-41e4-9aa8-37cadd75f829 => generated 1756 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 21:09:52.710831 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-74992b5c-c9c7-43a3-88fe-975853c84b3e tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 21:09:52.711429 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-74992b5c-c9c7-43a3-88fe-975853c84b3e tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] [instance: 6a2f4c8c-e968-41e4-9aa8-37cadd75f829] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 21:09:52.718535 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-74992b5c-c9c7-43a3-88fe-975853c84b3e tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:09:52.718981 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-74992b5c-c9c7-43a3-88fe-975853c84b3e tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:09:52.719734 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-74992b5c-c9c7-43a3-88fe-975853c84b3e tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:09:52.720187 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-74992b5c-c9c7-43a3-88fe-975853c84b3e tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:09:52.863139 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-74992b5c-c9c7-43a3-88fe-975853c84b3e tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8170a0af23d94859adea5840424c4d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fd0a48966e24e63a11fc4ee42a10330', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 21:09:52.871349 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-74992b5c-c9c7-43a3-88fe-975853c84b3e tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] 10.222.0.20 "GET /compute/v2.1/servers/6a2f4c8c-e968-41e4-9aa8-37cadd75f829" status: 200 len: 1756 microversion: 2.1 time: 0.164360 Jul 05 21:09:52.871904 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 499/1019] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 21:09:52 2022] GET /compute/v2.1/servers/6a2f4c8c-e968-41e4-9aa8-37cadd75f829 => generated 1756 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 21:09:53.888715 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-df91faf6-636b-4360-8cf1-bde33ab33a00 tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 21:09:53.889345 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-df91faf6-636b-4360-8cf1-bde33ab33a00 tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] [instance: 6a2f4c8c-e968-41e4-9aa8-37cadd75f829] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 21:09:53.895792 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-df91faf6-636b-4360-8cf1-bde33ab33a00 tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:09:53.896231 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-df91faf6-636b-4360-8cf1-bde33ab33a00 tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:09:53.897039 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-df91faf6-636b-4360-8cf1-bde33ab33a00 tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:09:53.897470 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-df91faf6-636b-4360-8cf1-bde33ab33a00 tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:09:54.043386 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-df91faf6-636b-4360-8cf1-bde33ab33a00 tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8170a0af23d94859adea5840424c4d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fd0a48966e24e63a11fc4ee42a10330', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 21:09:54.051534 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-df91faf6-636b-4360-8cf1-bde33ab33a00 tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] 10.222.0.20 "GET /compute/v2.1/servers/6a2f4c8c-e968-41e4-9aa8-37cadd75f829" status: 200 len: 1759 microversion: 2.1 time: 0.166687 Jul 05 21:09:54.052096 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 521/1020] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 21:09:53 2022] GET /compute/v2.1/servers/6a2f4c8c-e968-41e4-9aa8-37cadd75f829 => generated 1759 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 21:10:26.288163 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-7f28b208-0f32-4d4b-be54-474449fe8fcd tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-946361573"}} {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 21:10:26.288777 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-7f28b208-0f32-4d4b-be54-474449fe8fcd tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] [instance: 6a2f4c8c-e968-41e4-9aa8-37cadd75f829] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 21:10:26.291689 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG dbcounter [-] [117627] Writing DB stats nova_api:SELECT=16 {{(pid=117627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:26.292815 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG dbcounter [-] [117627] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:26.304572 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-7f28b208-0f32-4d4b-be54-474449fe8fcd tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:10:26.305061 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-7f28b208-0f32-4d4b-be54-474449fe8fcd tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:10:26.305889 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-7f28b208-0f32-4d4b-be54-474449fe8fcd tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:10:26.306407 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-7f28b208-0f32-4d4b-be54-474449fe8fcd tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:10:26.452058 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.network.security_group_api [None req-7f28b208-0f32-4d4b-be54-474449fe8fcd tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] Removing security group f8de8828-da03-4d13-ae25-e99de65bf6fb from port 62999338-920c-4286-a36a-9a00c662f6da Jul 05 21:10:26.799683 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-7f28b208-0f32-4d4b-be54-474449fe8fcd tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] 10.222.0.20 "POST /compute/v2.1/servers/6a2f4c8c-e968-41e4-9aa8-37cadd75f829/action" status: 202 len: 0 microversion: 2.1 time: 0.515312 Jul 05 21:10:26.803445 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 500/1021] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Jul 5 21:10:26 2022] POST /compute/v2.1/servers/6a2f4c8c-e968-41e4-9aa8-37cadd75f829/action => generated 0 bytes in 517 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 05 21:10:26.808431 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [req-108af593-ad9e-444d-ac07-a6fae97008e2 req-80094185-c6ea-4fe4-a5f1-b0124ac55f84 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6a2f4c8c-e968-41e4-9aa8-37cadd75f829", "tag": "62999338-920c-4286-a36a-9a00c662f6da"}]} {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 21:10:26.812383 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG dbcounter [-] [117628] Writing DB stats nova_api:SELECT=16 {{(pid=117628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:26.819919 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG dbcounter [-] [117628] Writing DB stats nova_cell1:SELECT=48 {{(pid=117628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:26.828919 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [req-108af593-ad9e-444d-ac07-a6fae97008e2 req-80094185-c6ea-4fe4-a5f1-b0124ac55f84 service nova] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:10:26.829385 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [req-108af593-ad9e-444d-ac07-a6fae97008e2 req-80094185-c6ea-4fe4-a5f1-b0124ac55f84 service nova] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:10:26.847317 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.compute.server_external_events [req-108af593-ad9e-444d-ac07-a6fae97008e2 req-80094185-c6ea-4fe4-a5f1-b0124ac55f84 service nova] Creating event network-changed:62999338-920c-4286-a36a-9a00c662f6da for instance 6a2f4c8c-e968-41e4-9aa8-37cadd75f829 on hv-cinder-79760 Jul 05 21:10:26.854496 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [req-108af593-ad9e-444d-ac07-a6fae97008e2 req-80094185-c6ea-4fe4-a5f1-b0124ac55f84 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050462 Jul 05 21:10:26.855613 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 522/1022] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 5 21:10:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 05 21:10:27.963020 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-a2b6cb56-f320-479b-b255-170ec0d9a726 tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 21:10:27.963528 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-a2b6cb56-f320-479b-b255-170ec0d9a726 tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] [instance: 6a2f4c8c-e968-41e4-9aa8-37cadd75f829] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 21:10:27.970370 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-a2b6cb56-f320-479b-b255-170ec0d9a726 tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:10:27.970775 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-a2b6cb56-f320-479b-b255-170ec0d9a726 tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:10:27.971619 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-a2b6cb56-f320-479b-b255-170ec0d9a726 tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:10:27.972160 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-a2b6cb56-f320-479b-b255-170ec0d9a726 tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:10:28.034491 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [req-626091d0-aea5-4dd9-90e2-8156442f16cc req-aff2f5f8-a731-4a12-814a-d9e5abfa6e03 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6a2f4c8c-e968-41e4-9aa8-37cadd75f829", "tag": "62999338-920c-4286-a36a-9a00c662f6da"}]} {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 21:10:28.042924 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [req-626091d0-aea5-4dd9-90e2-8156442f16cc req-aff2f5f8-a731-4a12-814a-d9e5abfa6e03 service nova] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:10:28.043705 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [req-626091d0-aea5-4dd9-90e2-8156442f16cc req-aff2f5f8-a731-4a12-814a-d9e5abfa6e03 service nova] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:10:28.056437 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.compute.server_external_events [req-626091d0-aea5-4dd9-90e2-8156442f16cc req-aff2f5f8-a731-4a12-814a-d9e5abfa6e03 service nova] Creating event network-changed:62999338-920c-4286-a36a-9a00c662f6da for instance 6a2f4c8c-e968-41e4-9aa8-37cadd75f829 on hv-cinder-79760 Jul 05 21:10:28.061471 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [req-626091d0-aea5-4dd9-90e2-8156442f16cc req-aff2f5f8-a731-4a12-814a-d9e5abfa6e03 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100765 Jul 05 21:10:28.062263 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 523/1023] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 5 21:10:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 21:10:28.069824 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.objects.instance [None req-a2b6cb56-f320-479b-b255-170ec0d9a726 tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] Lazy-loading 'services' on Instance uuid 6a2f4c8c-e968-41e4-9aa8-37cadd75f829 {{(pid=117627) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 05 21:10:28.153376 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-a2b6cb56-f320-479b-b255-170ec0d9a726 tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] 10.222.0.20 "DELETE /compute/v2.1/servers/6a2f4c8c-e968-41e4-9aa8-37cadd75f829/os-volume_attachments/a8af5f3b-3648-49d6-bce3-e0d4e9461499" status: 202 len: 0 microversion: 2.1 time: 0.194928 Jul 05 21:10:28.153946 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 501/1024] 10.222.0.20 () {58 vars in 1415 bytes} [Tue Jul 5 21:10:27 2022] DELETE /compute/v2.1/servers/6a2f4c8c-e968-41e4-9aa8-37cadd75f829/os-volume_attachments/a8af5f3b-3648-49d6-bce3-e0d4e9461499 => generated 0 bytes in 197 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 05 21:10:28.163309 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-0084d3ba-abbd-48f9-ae95-c930259510bd tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 21:10:28.164614 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-0084d3ba-abbd-48f9-ae95-c930259510bd tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] [instance: 6a2f4c8c-e968-41e4-9aa8-37cadd75f829] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 21:10:28.172730 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-0084d3ba-abbd-48f9-ae95-c930259510bd tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:10:28.173461 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-0084d3ba-abbd-48f9-ae95-c930259510bd tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:10:28.174689 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-0084d3ba-abbd-48f9-ae95-c930259510bd tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:10:28.175264 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-0084d3ba-abbd-48f9-ae95-c930259510bd tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:10:28.208433 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-0084d3ba-abbd-48f9-ae95-c930259510bd tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] 10.222.0.20 "GET /compute/v2.1/servers/6a2f4c8c-e968-41e4-9aa8-37cadd75f829/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049794 Jul 05 21:10:28.209032 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 524/1025] 10.222.0.20 () {58 vars in 1301 bytes} [Tue Jul 5 21:10:28 2022] GET /compute/v2.1/servers/6a2f4c8c-e968-41e4-9aa8-37cadd75f829/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 21:10:29.220814 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-c0a18d3b-732a-422d-95bd-b7a7565af3fd tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 21:10:29.221909 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-c0a18d3b-732a-422d-95bd-b7a7565af3fd tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] [instance: 6a2f4c8c-e968-41e4-9aa8-37cadd75f829] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 21:10:29.228437 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-c0a18d3b-732a-422d-95bd-b7a7565af3fd tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:10:29.228884 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-c0a18d3b-732a-422d-95bd-b7a7565af3fd tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:10:29.229670 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-c0a18d3b-732a-422d-95bd-b7a7565af3fd tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:10:29.230108 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-c0a18d3b-732a-422d-95bd-b7a7565af3fd tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:10:29.258231 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-c0a18d3b-732a-422d-95bd-b7a7565af3fd tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] 10.222.0.20 "GET /compute/v2.1/servers/6a2f4c8c-e968-41e4-9aa8-37cadd75f829/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042186 Jul 05 21:10:29.259305 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 502/1026] 10.222.0.20 () {58 vars in 1301 bytes} [Tue Jul 5 21:10:29 2022] GET /compute/v2.1/servers/6a2f4c8c-e968-41e4-9aa8-37cadd75f829/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 05 21:10:29.269066 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-fd4e9bd1-f2ae-4ede-acc8-2b4481bbcadf tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 21:10:29.269562 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-fd4e9bd1-f2ae-4ede-acc8-2b4481bbcadf tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] [instance: 6a2f4c8c-e968-41e4-9aa8-37cadd75f829] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 21:10:29.276758 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-fd4e9bd1-f2ae-4ede-acc8-2b4481bbcadf tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:10:29.277227 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-fd4e9bd1-f2ae-4ede-acc8-2b4481bbcadf tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:10:29.277973 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-fd4e9bd1-f2ae-4ede-acc8-2b4481bbcadf tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:10:29.278400 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-fd4e9bd1-f2ae-4ede-acc8-2b4481bbcadf tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:10:29.351623 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.wsgi [None req-fd4e9bd1-f2ae-4ede-acc8-2b4481bbcadf tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] HTTP exception thrown: Instance 6a2f4c8c-e968-41e4-9aa8-37cadd75f829 is not attached to volume a8af5f3b-3648-49d6-bce3-e0d4e9461499 Jul 05 21:10:29.353944 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-fd4e9bd1-f2ae-4ede-acc8-2b4481bbcadf tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] Request method failure captured: Jul 05 21:10:29.353944 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: request: DELETE /compute/v2.1/servers/6a2f4c8c-e968-41e4-9aa8-37cadd75f829/os-volume_attachments/a8af5f3b-3648-49d6-bce3-e0d4e9461499 HTTP/1.1 Jul 05 21:10:29.353944 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: Accept: application/json Jul 05 21:10:29.353944 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: Accept-Encoding: identity Jul 05 21:10:29.353944 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: Connection: close Jul 05 21:10:29.353944 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: Content-Length: 0 Jul 05 21:10:29.353944 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: Content-Type: application/json Jul 05 21:10:29.353944 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: Host: 10.222.0.20 Jul 05 21:10:29.353944 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: Openstack-System-Scope: None Jul 05 21:10:29.353944 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: User-Agent: python-urllib3/1.26.9 Jul 05 21:10:29.353944 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Auth-Token: gAAAAABixKhMrAhfvLHeP4Fp9i14VvyVnNNBEWuxUACc3L2gy3t9Ol6G7FlVe2NHGncZOSwSu-BdYGoawordLAiiz0B1f-y7tXI9uM8CkBfsQ_XntHbkQ0uTribAfzBCtAJuU6dvDUokKpcKg6Kg6EGv5zFvAZIFxbx6znhn2AFRbCv5CocSgTM Jul 05 21:10:29.353944 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Domain-Id: None Jul 05 21:10:29.353944 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Domain-Name: None Jul 05 21:10:29.353944 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Identity-Status: Confirmed Jul 05 21:10:29.353944 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Is-Admin-Project: True Jul 05 21:10:29.353944 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Project-Domain-Id: default Jul 05 21:10:29.353944 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Project-Domain-Name: Default Jul 05 21:10:29.353944 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Project-Id: 0fd0a48966e24e63a11fc4ee42a10330 Jul 05 21:10:29.353944 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Project-Name: tempest-TestMinimumBasicScenario-1842529726 Jul 05 21:10:29.353944 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Role: member,reader Jul 05 21:10:29.353944 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Roles: member,reader Jul 05 21:10:29.355756 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0fd0a48966e24e63a11fc4ee42a10330"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/0fd0a48966e24e63a11fc4ee42a10330"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_0fd0a48966e24e63a11fc4ee42a10330"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0fd0a48966e24e63a11fc4ee42a10330"}]}] Jul 05 21:10:29.355756 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Tenant: tempest-TestMinimumBasicScenario-1842529726 Jul 05 21:10:29.355756 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Tenant-Id: 0fd0a48966e24e63a11fc4ee42a10330 Jul 05 21:10:29.355756 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1842529726 Jul 05 21:10:29.355756 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-User: tempest-TestMinimumBasicScenario-1842529726-project Jul 05 21:10:29.355756 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-User-Domain-Id: default Jul 05 21:10:29.355756 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-User-Domain-Name: Default Jul 05 21:10:29.355756 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-User-Id: 8170a0af23d94859adea5840424c4d70 Jul 05 21:10:29.355756 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-User-Name: tempest-TestMinimumBasicScenario-1842529726-project Jul 05 21:10:29.355756 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: method: > Jul 05 21:10:29.355756 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: exception: Instance 6a2f4c8c-e968-41e4-9aa8-37cadd75f829 is not attached to volume a8af5f3b-3648-49d6-bce3-e0d4e9461499 Jul 05 21:10:29.356630 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: action_args: {'server_id': '6a2f4c8c-e968-41e4-9aa8-37cadd75f829', 'id': 'a8af5f3b-3648-49d6-bce3-e0d4e9461499'} Jul 05 21:10:29.356630 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 05 21:10:29.356630 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 21:10:29.356630 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jul 05 21:10:29.356630 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jul 05 21:10:29.356630 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 05 21:10:29.356630 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 05 21:10:29.356630 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jul 05 21:10:29.356630 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jul 05 21:10:29.356630 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id a8af5f3b-3648-49d6-bce3-e0d4e9461499. Jul 05 21:10:29.356630 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi Jul 05 21:10:29.356630 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 21:10:29.356630 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi Jul 05 21:10:29.356630 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 21:10:29.356630 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 21:10:29.356630 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 21:10:29.356630 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 05 21:10:29.356630 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 05 21:10:29.356630 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 05 21:10:29.358257 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 05 21:10:29.358257 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jul 05 21:10:29.358257 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 05 21:10:29.358257 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6a2f4c8c-e968-41e4-9aa8-37cadd75f829 is not attached to volume a8af5f3b-3648-49d6-bce3-e0d4e9461499 Jul 05 21:10:29.358257 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi Jul 05 21:10:29.358257 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 21:10:29.358257 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi Jul 05 21:10:29.358257 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 21:10:29.358257 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 21:10:29.358257 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 21:10:29.358257 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 05 21:10:29.358257 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 05 21:10:29.358257 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6a2f4c8c-e968-41e4-9aa8-37cadd75f829 is not attached to volume a8af5f3b-3648-49d6-bce3-e0d4e9461499 Jul 05 21:10:29.358257 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi Jul 05 21:10:29.358257 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-fd4e9bd1-f2ae-4ede-acc8-2b4481bbcadf tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] Returning 404 to user: Instance 6a2f4c8c-e968-41e4-9aa8-37cadd75f829 is not attached to volume a8af5f3b-3648-49d6-bce3-e0d4e9461499 {{(pid=117628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 05 21:10:29.359487 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-fd4e9bd1-f2ae-4ede-acc8-2b4481bbcadf tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] 10.222.0.20 "DELETE /compute/v2.1/servers/6a2f4c8c-e968-41e4-9aa8-37cadd75f829/os-volume_attachments/a8af5f3b-3648-49d6-bce3-e0d4e9461499" status: 404 len: 154 microversion: 2.1 time: 0.090269 Jul 05 21:10:29.359487 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 525/1027] 10.222.0.20 () {58 vars in 1415 bytes} [Tue Jul 5 21:10:29 2022] DELETE /compute/v2.1/servers/6a2f4c8c-e968-41e4-9aa8-37cadd75f829/os-volume_attachments/a8af5f3b-3648-49d6-bce3-e0d4e9461499 => generated 154 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 05 21:10:30.490868 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-5b30ed10-48cb-4f3a-bdbd-1e628f425f81 tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 21:10:30.491358 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-5b30ed10-48cb-4f3a-bdbd-1e628f425f81 tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] [instance: 6a2f4c8c-e968-41e4-9aa8-37cadd75f829] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 21:10:30.498405 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-5b30ed10-48cb-4f3a-bdbd-1e628f425f81 tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:10:30.498850 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-5b30ed10-48cb-4f3a-bdbd-1e628f425f81 tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:10:30.499600 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-5b30ed10-48cb-4f3a-bdbd-1e628f425f81 tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:10:30.500027 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-5b30ed10-48cb-4f3a-bdbd-1e628f425f81 tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:10:30.524610 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-5b30ed10-48cb-4f3a-bdbd-1e628f425f81 tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] [instance: 6a2f4c8c-e968-41e4-9aa8-37cadd75f829] Going to try to terminate instance {{(pid=117627) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 05 21:10:30.598539 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-5b30ed10-48cb-4f3a-bdbd-1e628f425f81 tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] 10.222.0.20 "DELETE /compute/v2.1/servers/6a2f4c8c-e968-41e4-9aa8-37cadd75f829" status: 204 len: 0 microversion: 2.1 time: 0.111264 Jul 05 21:10:30.599428 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 503/1028] 10.222.0.20 () {58 vars in 1238 bytes} [Tue Jul 5 21:10:30 2022] DELETE /compute/v2.1/servers/6a2f4c8c-e968-41e4-9aa8-37cadd75f829 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 05 21:10:30.608728 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-eef88055-29da-40c2-96b4-ea206675e4d2 tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 21:10:30.609366 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-eef88055-29da-40c2-96b4-ea206675e4d2 tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] [instance: 6a2f4c8c-e968-41e4-9aa8-37cadd75f829] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 21:10:30.615866 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-eef88055-29da-40c2-96b4-ea206675e4d2 tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:10:30.616315 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-eef88055-29da-40c2-96b4-ea206675e4d2 tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:10:30.617108 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-eef88055-29da-40c2-96b4-ea206675e4d2 tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:10:30.617543 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-eef88055-29da-40c2-96b4-ea206675e4d2 tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:10:30.750542 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-eef88055-29da-40c2-96b4-ea206675e4d2 tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8170a0af23d94859adea5840424c4d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fd0a48966e24e63a11fc4ee42a10330', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 21:10:30.758091 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-eef88055-29da-40c2-96b4-ea206675e4d2 tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] 10.222.0.20 "GET /compute/v2.1/servers/6a2f4c8c-e968-41e4-9aa8-37cadd75f829" status: 200 len: 1554 microversion: 2.1 time: 0.153160 Jul 05 21:10:30.758660 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 526/1029] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 21:10:30 2022] GET /compute/v2.1/servers/6a2f4c8c-e968-41e4-9aa8-37cadd75f829 => generated 1554 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 21:10:31.776060 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-e48e2125-0eb4-4de4-9e90-0d3c103c1eff tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] Calling method '>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 21:10:31.776780 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.compute.api [None req-e48e2125-0eb4-4de4-9e90-0d3c103c1eff tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] [instance: 6a2f4c8c-e968-41e4-9aa8-37cadd75f829] Fetching instance by UUID {{(pid=117627) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 21:10:31.783546 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-e48e2125-0eb4-4de4-9e90-0d3c103c1eff tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:10:31.783992 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-e48e2125-0eb4-4de4-9e90-0d3c103c1eff tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:10:31.784744 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-e48e2125-0eb4-4de4-9e90-0d3c103c1eff tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:10:31.785209 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [None req-e48e2125-0eb4-4de4-9e90-0d3c103c1eff tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:10:31.911135 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.policy [None req-e48e2125-0eb4-4de4-9e90-0d3c103c1eff tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8170a0af23d94859adea5840424c4d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fd0a48966e24e63a11fc4ee42a10330', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117627) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 21:10:31.918775 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-e48e2125-0eb4-4de4-9e90-0d3c103c1eff tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] 10.222.0.20 "GET /compute/v2.1/servers/6a2f4c8c-e968-41e4-9aa8-37cadd75f829" status: 200 len: 1554 microversion: 2.1 time: 0.147011 Jul 05 21:10:31.919328 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 504/1030] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 21:10:31 2022] GET /compute/v2.1/servers/6a2f4c8c-e968-41e4-9aa8-37cadd75f829 => generated 1554 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 21:10:32.936181 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-9df82fae-7137-49e1-ba30-f026af466858 tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 21:10:32.937444 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-9df82fae-7137-49e1-ba30-f026af466858 tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] [instance: 6a2f4c8c-e968-41e4-9aa8-37cadd75f829] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 21:10:32.943842 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-9df82fae-7137-49e1-ba30-f026af466858 tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:10:32.944278 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-9df82fae-7137-49e1-ba30-f026af466858 tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:10:32.945184 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-9df82fae-7137-49e1-ba30-f026af466858 tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:10:32.945624 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-9df82fae-7137-49e1-ba30-f026af466858 tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:10:33.045061 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.policy [None req-9df82fae-7137-49e1-ba30-f026af466858 tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8170a0af23d94859adea5840424c4d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fd0a48966e24e63a11fc4ee42a10330', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117628) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 21:10:33.052586 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-9df82fae-7137-49e1-ba30-f026af466858 tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] 10.222.0.20 "GET /compute/v2.1/servers/6a2f4c8c-e968-41e4-9aa8-37cadd75f829" status: 200 len: 1512 microversion: 2.1 time: 0.120260 Jul 05 21:10:33.053191 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 527/1031] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 21:10:32 2022] GET /compute/v2.1/servers/6a2f4c8c-e968-41e4-9aa8-37cadd75f829 => generated 1512 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 21:10:33.072744 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [req-b8cd9615-e842-4ee6-9e72-c4d136923115 req-3a4e9a16-9049-403d-94bf-bfbe785d9569 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a2f4c8c-e968-41e4-9aa8-37cadd75f829", "name": "network-vif-deleted", "tag": "62999338-920c-4286-a36a-9a00c662f6da"}]} {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 21:10:33.081941 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [req-b8cd9615-e842-4ee6-9e72-c4d136923115 req-3a4e9a16-9049-403d-94bf-bfbe785d9569 service nova] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:10:33.082387 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG oslo_concurrency.lockutils [req-b8cd9615-e842-4ee6-9e72-c4d136923115 req-3a4e9a16-9049-403d-94bf-bfbe785d9569 service nova] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:10:33.095996 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.compute.server_external_events [req-b8cd9615-e842-4ee6-9e72-c4d136923115 req-3a4e9a16-9049-403d-94bf-bfbe785d9569 service nova] Creating event network-vif-deleted:62999338-920c-4286-a36a-9a00c662f6da for instance 6a2f4c8c-e968-41e4-9aa8-37cadd75f829 on hv-cinder-79760 Jul 05 21:10:33.101225 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [req-b8cd9615-e842-4ee6-9e72-c4d136923115 req-3a4e9a16-9049-403d-94bf-bfbe785d9569 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032897 Jul 05 21:10:33.101852 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 505/1032] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 5 21:10:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 21:10:34.069761 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-a1a4eb65-7274-48fc-9557-025a870099db tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] Calling method '>' {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 21:10:34.070397 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.compute.api [None req-a1a4eb65-7274-48fc-9557-025a870099db tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] [instance: 6a2f4c8c-e968-41e4-9aa8-37cadd75f829] Fetching instance by UUID {{(pid=117628) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 21:10:34.077517 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-a1a4eb65-7274-48fc-9557-025a870099db tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:10:34.077958 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-a1a4eb65-7274-48fc-9557-025a870099db tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:10:34.078708 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-a1a4eb65-7274-48fc-9557-025a870099db tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 21:10:34.079136 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG oslo_concurrency.lockutils [None req-a1a4eb65-7274-48fc-9557-025a870099db tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] Lock "78cfd685-d36c-4d6a-bc57-de3ea03c21ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 21:10:34.092066 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.wsgi [None req-a1a4eb65-7274-48fc-9557-025a870099db tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] HTTP exception thrown: Instance 6a2f4c8c-e968-41e4-9aa8-37cadd75f829 could not be found. Jul 05 21:10:34.093588 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-a1a4eb65-7274-48fc-9557-025a870099db tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] Request method failure captured: Jul 05 21:10:34.093588 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: request: GET /compute/v2.1/servers/6a2f4c8c-e968-41e4-9aa8-37cadd75f829 HTTP/1.1 Jul 05 21:10:34.093588 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: Accept: application/json Jul 05 21:10:34.093588 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: Accept-Encoding: identity Jul 05 21:10:34.093588 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: Connection: close Jul 05 21:10:34.093588 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: Content-Length: 0 Jul 05 21:10:34.093588 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: Content-Type: application/json Jul 05 21:10:34.093588 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: Host: 10.222.0.20 Jul 05 21:10:34.093588 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: Openstack-System-Scope: None Jul 05 21:10:34.093588 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: User-Agent: python-urllib3/1.26.9 Jul 05 21:10:34.093588 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Auth-Token: gAAAAABixKhMrAhfvLHeP4Fp9i14VvyVnNNBEWuxUACc3L2gy3t9Ol6G7FlVe2NHGncZOSwSu-BdYGoawordLAiiz0B1f-y7tXI9uM8CkBfsQ_XntHbkQ0uTribAfzBCtAJuU6dvDUokKpcKg6Kg6EGv5zFvAZIFxbx6znhn2AFRbCv5CocSgTM Jul 05 21:10:34.093588 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Domain-Id: None Jul 05 21:10:34.093588 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Domain-Name: None Jul 05 21:10:34.093588 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Identity-Status: Confirmed Jul 05 21:10:34.093588 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Is-Admin-Project: True Jul 05 21:10:34.093588 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Project-Domain-Id: default Jul 05 21:10:34.093588 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Project-Domain-Name: Default Jul 05 21:10:34.093588 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Project-Id: 0fd0a48966e24e63a11fc4ee42a10330 Jul 05 21:10:34.093588 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Project-Name: tempest-TestMinimumBasicScenario-1842529726 Jul 05 21:10:34.093588 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Role: member,reader Jul 05 21:10:34.093588 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Roles: member,reader Jul 05 21:10:34.095236 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0fd0a48966e24e63a11fc4ee42a10330"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/0fd0a48966e24e63a11fc4ee42a10330"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_0fd0a48966e24e63a11fc4ee42a10330"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0fd0a48966e24e63a11fc4ee42a10330"}]}] Jul 05 21:10:34.095236 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Tenant: tempest-TestMinimumBasicScenario-1842529726 Jul 05 21:10:34.095236 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Tenant-Id: 0fd0a48966e24e63a11fc4ee42a10330 Jul 05 21:10:34.095236 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1842529726 Jul 05 21:10:34.095236 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-User: tempest-TestMinimumBasicScenario-1842529726-project Jul 05 21:10:34.095236 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-User-Domain-Id: default Jul 05 21:10:34.095236 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-User-Domain-Name: Default Jul 05 21:10:34.095236 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-User-Id: 8170a0af23d94859adea5840424c4d70 Jul 05 21:10:34.095236 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: X-User-Name: tempest-TestMinimumBasicScenario-1842529726-project Jul 05 21:10:34.095236 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: method: > Jul 05 21:10:34.095236 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: exception: Instance 6a2f4c8c-e968-41e4-9aa8-37cadd75f829 could not be found. Jul 05 21:10:34.095236 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: action_args: {'id': '6a2f4c8c-e968-41e4-9aa8-37cadd75f829'} Jul 05 21:10:34.096188 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: {{(pid=117628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 05 21:10:34.096188 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 21:10:34.096188 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 05 21:10:34.096188 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 05 21:10:34.096188 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 05 21:10:34.096188 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 05 21:10:34.096188 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 05 21:10:34.096188 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 05 21:10:34.096188 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 05 21:10:34.096188 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 05 21:10:34.096188 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6a2f4c8c-e968-41e4-9aa8-37cadd75f829 could not be found. Jul 05 21:10:34.096188 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi Jul 05 21:10:34.096188 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 21:10:34.096188 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi Jul 05 21:10:34.096188 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 21:10:34.096188 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 21:10:34.096188 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 21:10:34.096188 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 05 21:10:34.096188 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 05 21:10:34.096188 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 05 21:10:34.097787 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 05 21:10:34.097787 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 05 21:10:34.097787 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 05 21:10:34.097787 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 05 21:10:34.097787 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 05 21:10:34.097787 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 05 21:10:34.097787 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 05 21:10:34.097787 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6a2f4c8c-e968-41e4-9aa8-37cadd75f829 could not be found. Jul 05 21:10:34.097787 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi Jul 05 21:10:34.097787 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 21:10:34.097787 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi Jul 05 21:10:34.097787 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 21:10:34.097787 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 21:10:34.097787 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 21:10:34.097787 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 05 21:10:34.097787 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 05 21:10:34.097787 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6a2f4c8c-e968-41e4-9aa8-37cadd75f829 could not be found. Jul 05 21:10:34.097787 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: ERROR nova.api.openstack.wsgi Jul 05 21:10:34.099273 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: DEBUG nova.api.openstack.wsgi [None req-a1a4eb65-7274-48fc-9557-025a870099db tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] Returning 404 to user: Instance 6a2f4c8c-e968-41e4-9aa8-37cadd75f829 could not be found. {{(pid=117628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 05 21:10:34.099273 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO nova.api.openstack.requestlog [None req-a1a4eb65-7274-48fc-9557-025a870099db tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] 10.222.0.20 "GET /compute/v2.1/servers/6a2f4c8c-e968-41e4-9aa8-37cadd75f829" status: 404 len: 111 microversion: 2.1 time: 0.029059 Jul 05 21:10:34.099273 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: [pid: 117628|app: 0|req: 528/1033] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 5 21:10:34 2022] GET /compute/v2.1/servers/6a2f4c8c-e968-41e4-9aa8-37cadd75f829 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 05 21:10:34.105112 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: DEBUG nova.api.openstack.wsgi [None req-1a42c09d-3bc3-40f9-a8bb-ed6265542510 tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] Calling method '.version_select at 0x7f57cded5040>' {{(pid=117627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 21:10:34.123735 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO nova.api.openstack.requestlog [None req-1a42c09d-3bc3-40f9-a8bb-ed6265542510 tempest-TestMinimumBasicScenario-1842529726 tempest-TestMinimumBasicScenario-1842529726-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-142085630" status: 202 len: 0 microversion: 2.1 time: 0.023841 Jul 05 21:10:34.124297 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: [pid: 117627|app: 0|req: 506/1034] 10.222.0.20 () {58 vars in 1268 bytes} [Tue Jul 5 21:10:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-142085630 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 05 21:11:12.760734 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 05 21:11:12.761403 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: Tue Jul 5 21:11:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 05 21:11:26.235127 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 05 21:11:26.235837 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: Tue Jul 5 21:11:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 05 21:12:46.622233 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 05 21:12:46.622861 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: Tue Jul 5 21:12:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 05 21:13:07.128094 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 05 21:13:07.128816 dv-cinder-797608-49-iscsi devstack@n-api.service[117627]: Tue Jul 5 21:13:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 05 21:13:21.704633 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 05 21:13:21.705252 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: Tue Jul 5 21:13:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 05 21:14:32.770822 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 05 21:14:32.771636 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: Tue Jul 5 21:14:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 05 21:14:46.243311 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 05 21:14:46.243973 dv-cinder-797608-49-iscsi devstack@n-api.service[117628]: Tue Jul 5 21:14:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!